Hello there,
I understand the wish to be independent from non-open-source libraries but (other than http://openstt.org says) there already are open source STT services/libraries like CMUSphinx.
Why do you want to create a service from scratch when there are alternatives? I love this projects idea but I fear that investing so much energy in openstt would hinder the progress of mycroft.