1. Grate the sweet potatoes coarsely. In a separate bowl mix the flour, sugar, brown sugar, baking powder, cayenne pepper, curry powder, cumin, and salt and pepper.
2. Add the eggs and just enough milk to the dry ingredients to make a stiff batter. Add the potatoes and mix. The batter should be moist but not runny; if too stiff, add more milk.
3. Heat 1/4 inch of peanut oil in a frying pan until it is barely smoking. Drop in the batter by tablespoons and flatten. Fry over medium-high heat several minutes on each side until golden. Drain on paper towels and serve.