In a large bowl, beat the eggs and milk together. Season with nutmeg, salt, and pepper, to taste. Set aside.
Place a large ovenproof skillet over medium high heat, preferably a cast iron skillet. Add the olive oil and heat until hot. Add the sweet potato and onion and cook until tender, about 8-10 minutes. Add the garlic, rosemary, and kale and cook until kale is wilted. Season with salt and black pepper, to taste.
Remove half of the mixture from the pan and set aside. Pour the egg mixture into the pan, over the sweet potatoes, kale, onion, and garlic. Add the reserved mixture back to the pan, making sure you evenly spread out the ingredients. Cook for 3-4 minutes or until just set. Top with crumbled goat cheese.
Place the pan into the oven and bake for 8-10 minutes or until eggs are firm and edges are golden brown. Remove from the oven and cut into wedges. Serve immediately.