Most recent activity
-
Okay thanks for the detailed response, it all makes sense.. Is this feature for BangleJS-2 multi-ble connections on the roadmap?
Thankfully it is no problem to develop a work-around solution for my use-case, at least for the POC.
In my case 'a few' is two devices.
-
I am attempting to connect to a few bluetooth peripherals from the BangleJS-2. But I get the following error after the first one connects, and the second attempts to establish a connection: ERR 0x12 (CONN_COUNT)
Are multiple BLE connections possible on the BangleJS-2.
Cheers.
-
@JumJum Fantastic work! I have updated the versions on my repo and it still work (surprising as its a major version bump)
I have added a download button which will bring down the model on the prediction page.
I ran through the conversion steps you posted, and they do produce a TFLite model (your Google-Fu is strong!)
The problem I see now is that the TFLite model it produces is ~14Kb, and around 19Kb when converted to base64. I'm not sure if this is too large. I see the python script does quantization to optimize for size.
I went through the steps @Gordon linked to, and the emulator runs out of memory, and I checked the model on the gesture app its around 5K. So maybe we can do some optimization during the conversion process?
-
Thanks @ConorONeill ! It will be interesting to see how this project evolves.
I look forward to see what you build @JumJum, it's all very exciting.
Just a quick note on all this: I have looked high and low for scripts that convert TFJS generated models to other model types (especially TFLite as that's what we require for the Bangle), and I don't see any, I also came across a post from April this year (by a TF contributor I believe) that said you can only convert models to TFJS not the other way around, and they don't plan on introducing that feature.
I just don't want people to invest to much time only to find out there is a massive dead-end with model conversion.
Hopefully I am wrong, and someone elses Google-Fu is better than mine and comes across a solution.
-
@JumJum Glad it worked for you!
@Gordon Cool, yeah I think the gesture detection stuff opens up many doors for cool projects.Well as per the apps, this belongs to the community, so if you missed the repo link in the site, here it is: https://github.com/paulcockrell/bangle-tensorflow-game
(The 'game' in the repo name is there as I had a PhaserIO game hooked in but this was too much of a distraction to the point of the repo, so I removed it)
Please feel free to fork the repo and work on it, I don't know how you will go about coordinating if its not in the main Bangle repo (for issues and feature requests).
I cannot guarantee my availability for chipping in on this so please take over and run with it... I'll join in where I can :)
Cheers.
Paul C
Side note: It looks like you would have to have an endpoint on a server to convert the generated tfjs model to any other model type, doesn't appear to be a part of TensorflowJS Api unfortunately.
The model this generates is in local storage (devtools->application->local storage)
-
Yeah its all in the browser!
Yes you will get an unhelpfull 'training failed' message if you record only one gesture..
The UI is a bit non-intuitive, but these are the steps to do a successful train:
- Enter gesture name + select sample size (5 is fine if the gesture movements are very different)
- Click "Record gesture" .. the page will scroll down to the feed back section, wait for the feed back bar to turn red (recording mode) and the message to say its ready.
- Perform your gestures (first always fails as it needs the raw data to be cleaned..)
- Once the feedback bar goes green, scroll back up to the top of the page, and enter a NEW gesture name, keep the sample value the same as before.
- Perform steps 2-3 again
- Now you will have recorded TWO gestures (you can confirm this in the bangle gesture readings section at the bottom of page)
- Click train, and let the magic happen.
I can certainly look at having it generate a TFLite model. I wanted to know if this was something of use to the community before investing much time!
Let me know if you are successful.
- Enter gesture name + select sample size (5 is fine if the gesture movements are very different)
-
Hi, as this is not an app, for the app store, I thought I'd post it here and see what people made of it.
I have put together a purely online gesture learning AI for the BangleJS: https://paulcockrell.github.io/banglejs-tensorflow-example/
This is not the same as the one that generates a model in Python, for you to load into the Bangle. But rather this simply lets your bangle send raw gesture data to the browser, and it will use the Tensorflow model (stored in local storage in the browser) to predict your gestures.
Since the Espruino stuff is all about the Javascript, I thought it would be nice to have a pure JS implementation for gesture learning. Its all in the browser, so no server setup.
I don't know exactly how this would be applied to something (maybe browser card games, or menus..) but thought it would be fun.
Props to the following that helped alot with this project:
-
Hi @Robin, Yes I guess that might be a solution going forward, as we all hope the BangleCraze will take off soon, but that will lead to a flood of app submissions and as you point out that may bring a ton of issues.
@Gordon has really hit the nail on the head with the Bangle App store. I hope schools pick up on it, as I think this would get kids buzzing.. no soldering, electronics theory or easy to swallow components, just a chunky watch, a bit of JavaScript, and imagination. All other IOT projects can only really end up as lengthy blogs, and private implementations.
Back to the point tho, You raise good issues in your can-of-worms thread. I can't remember but did Pebble have a community app store, can we get hold of any ex-engineers to see what they did from a legal point of view etc?
This really isn't my area of expertise so I can't chip in.
Computerologist