Did you consider using off-the-shelf components instead of building everything from scratch? Often these have optimized software already... less headache. Plus you might save on the hardware if you keep frying it.