Contribution Request: Offline speech recognition

[patrickjquinn]

Hi guys, I want to include offline speech recognition that's open source to this project, initially just for English. It might be worth investigating the work of XNOR.ai and failing that, building a full, optimised model for PocketSphinx.

Longer term id like this model to to be trained by interactions with the platform and then have some sort of central repository for the model so it can be synced across all instances of the platform.

Any one willing to help? Or have any ideas?

[h4ckd0tm3]

Willing to do what i can to help! :)

[patrickjquinn]

Excellent thanks for the offer, what skills do you posses?

[h4ckd0tm3]

PHP, HTML, JavaScript, Java, C#....

I graduated at a Secondary Technical College in Engeneering in Austria. Working as Sysadmin. Advanced Linux skills.

Never worked with Node.js before but basic knowlege.

[patrickjquinn]

Okay that's perfect, have you ever worked with PocketSphinx or CMUSphinx before?

[Marak]

@patrickjquinn Which module is currently providing the speech recognition?

[h4ckd0tm3]

@patrickjquinn No but looks interesting! And im willing to study this shit xD

@Marak
As far as i know annyang

[patrickjquinn]

Ah the person behind say! I'm using your fantastic module for the RasPi client!

At the moment, it's done using online APIs ( Google cloud speech and Wit.ai) and node-record-lpc16 to handle speech recognition on the clients.

I've experimented with PocketSphinx but found it to be...too unreliable.

Hence my desire to build something more fit-for task that can be trained dynamically and manually by the community. Open source SST would be a massive coo for the open source community working on projects such as this.

Think you might be able to help out?

[patrickjquinn]

@developingUnicorn excellent :) well I'd suggest you try and get https://github.com/cmusphinx/node-pocketsphinx or https://syl22-00.github.io/pocketsphinx.js/ (both JavaScript bindings for PocketSphinx) recognising speech locally that should be all the research you'll need :) you can contact me via the projects Gitter https://gitter.im/P-Brain/Lobby?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge

[patrickjquinn]

In order to kick this off, i've started a new project; Luther https://github.com/patrickjquinn/Luther (i.e Martin Luther King, i.e Free speech), initially just containing a giant text file of 450+k english words. I'll expand this to a giant list of english sentences, popular musicians and slang words sourced from various different databases of such information.

[patrickjquinn]

Okay guys so tomorrow I'm going to populate Luther with a set up guide for PocketSphinx and a precompiled English dictionary for it. I'll also create a basic node module for recording raw input and isolating the frequencies for human speech which should allow for easier extraction.

Also when the time comes that we have a solid platform, I'll host it on a beefy box "in the cloud" with 20 (I have some spare Azure hosting credits) or so cores so everyone can access it, via a simple API for their projects!

Can anyone who wants to help let me know so I can add them as admins to the Luther project?

[h4ckd0tm3]

I'll help! Started to playing around with pocketphinx and i'm totally i to this! Looking forward to be a part of this project!

[patrickjquinn]

Excellent, i'll add you as an admin! Did you make any progress getting it recognising speech?

[h4ckd0tm3]

Not by now, here in Austria we have to do military service by the age of 18 and i have 5 Months left so my time is limited. But i hope i'll geht it working by friday!

[patrickjquinn]

No rush! It's for your own benefit not mine :) I'll have everything mentioned above commited by tonight