Gentoo is kinda like that. Everything is compiled from source. You start by untarring an absolute minimal linux system, no kernel, no nothing. Then you install Portage, Gentoo's package manager, and it compiles all the packages from source right before your eyes. You can even set the compiler options and tailor them to your system exactly.
Is this a little like what you're looking for?
V