Brilliant Sole
@brilliantsole.bsky.social
Making smart insoles for developers. They have pressure sensors (8 per insole), 3DoF motion sensor, and haptics (2 per insole - heel and ball)
Experimenting with posture correction on smart glasses, giving led feedback based on head tilt Works with compatible smart glasses (in this case the PMSG, based on the @seeedstudio.com XIAO ESP32-S3, running our firmware)
Brilliant Sole@brilliantsole.bsky.social · 2mo agoUsing Depth Anything 3, we can detect the depth of objects relative to the user (in case behind the user), giving led/haptic feedback when something is too close
Using Depth Anything 3, we can detect the depth of objects relative to the user (in case behind the user), giving led/haptic feedback when something is too close
Brilliant Sole@brilliantsole.bsky.social · 2mo agoUsing smart glasses to make it easier to draw on your phone With our wearables SDK, we can stream camera data to a webpage on a smartphone, and use MediaPipe to create a cursor that uses your free hand to draw
Using smart glasses to make it easier to draw on your phone With our wearables SDK, we can stream camera data to a webpage on a smartphone, and use MediaPipe to create a cursor that uses your free hand to draw
Brilliant Sole@brilliantsole.bsky.social · 3mo agoNow you can save camera streams from your smart glasses as videos using our wearables SDK Also testing our firmware on the PMSG (Prototype Modular Smart Glasses), which is not only based on the @seeedstudio.com XIAO ESP32-S3, but comes with a bunch of other features (sensors, leds, haptics, etc)
Now you can save camera streams from your smart glasses as videos using our wearables SDK Also testing our firmware on the PMSG (Prototype Modular Smart Glasses), which is not only based on the @seeedstudio.com XIAO ESP32-S3, but comes with a bunch of other features (sensors, leds, haptics, etc)
Brilliant Sole@brilliantsole.bsky.social · 3mo agoLocal AI Assistant with TTS and wake word detection - say “look at this” to take a pic, and “question” to ask a follow up question Whisper for STT, Kokoro for TTS, and @edgeimpulse.com for making the wake model Works with compatible smart glasses, in this case the @seeedstudio.com Xiao esp32-S3
Local AI Assistant with TTS and wake word detection - say “look at this” to take a pic, and “question” to ask a follow up question Whisper for STT, Kokoro for TTS, and @edgeimpulse.com for making the wake model Works with compatible smart glasses, in this case the @seeedstudio.com Xiao esp32-S3
Brilliant Sole@brilliantsole.bsky.social · 3mo agoKeyword spotting running on smart glasses
Keyword spotting running on smart glasses
Brilliant Sole@brilliantsole.bsky.social · 3mo agoKeyword Spotting running on smart glasses Added microphone-based Tflite support to our Wearables SDK, allowing us to run ML models on compatible smart glasses (in this case @seeedstudio.com’s Xiao Esp32-S3 Sense, running our custom firmware) We also used @edgeimpulse.com to make the model
What if your virtual pet wasn’t just pixels on a screen, but something you could actually reach out and touch? A team at Reality Hack @ MIT 2026 made that idea real with Power Pet – a hybrid VR and physical companion that bridges the digital and tactile worlds.
Power Pet: a VR companion at your side | Arduino Blog
What if your virtual pet wasn’t just pixels on a screen, but something you could actually reach out and touch? A team at Reality Hack @ MIT 2026 made that idea real with Power Pet – a hybrid VR and ph...
blog.arduino.cc
Keyword Spotting running on smart glasses Added microphone-based Tflite support to our Wearables SDK, allowing us to run ML models on compatible smart glasses (in this case @seeedstudio.com’s Xiao Esp32-S3 Sense, running our custom firmware) We also used @edgeimpulse.com to make the model
Brilliant Sole@brilliantsole.bsky.social · 4mo agoExperimenting with locomotion in @vrchat.com using our smart insoles, sending OSC messages to the headset based on various configurations (hoverboard-like movement, stepping in place, etc)
Experimenting with locomotion in @vrchat.com using our smart insoles, sending OSC messages to the headset based on various configurations (hoverboard-like movement, stepping in place, etc)
Brilliant Sole@brilliantsole.bsky.social · 4mo agoExperimenting with different types of locomotion in VR with our smart insoles, from hoverboard-like controls to a “stepping in place” mechanic
Experimenting with different types of locomotion in VR with our smart insoles, from hoverboard-like controls to a “stepping in place” mechanic
Brilliant Sole@brilliantsole.bsky.social · 5mo agoSnowboarding with smart insoles Attended a PicoXR hackathon in sf last week and our team made a snowboarding demo The Pico browser has Web Bluetooth, allowing us to easily make a WebXR webpage that connects to our wearables - an underrated feature the Apple Vision Pro and Oculus Browser lack
Snowboarding with smart insoles Attended a PicoXR hackathon in sf last week and our team made a snowboarding demo The Pico browser has Web Bluetooth, allowing us to easily make a WebXR webpage that connects to our wearables - an underrated feature the Apple Vision Pro and Oculus Browser lack
Brilliant Sole@brilliantsole.bsky.social · 5mo agoPositional tracking on smart glasses and webcams Experimenting with @nianticspatial.bsky.social’s 8thWall engine, allowing us to determine position using camera and motion data
Positional tracking on smart glasses and webcams Experimenting with @nianticspatial.bsky.social’s 8thWall engine, allowing us to determine position using camera and motion data
Brilliant Sole@brilliantsole.bsky.social · 5mo agoTune your guitar with your smart glasses With our wearables SDK, we’re able to display pitch, allowing musicians to easily tune their instruments Works with compatible smartglasses, in this case the Brilliant Labs Frame running custom firmware
Tune your guitar with your smart glasses With our wearables SDK, we’re able to display pitch, allowing musicians to easily tune their instruments Works with compatible smartglasses, in this case the Brilliant Labs Frame running custom firmware
Brilliant Sole@brilliantsole.bsky.social · 5mo agoDisplay sheet music on your smart glasses, and tap your foot to turn the page With our wearables SDK, not only can we render musicXML files on compatible smartglasses, but we’re able to use our smart insoles to trigger page turns by running an @edgeimpulse.com model that detects foot taps on device
Display sheet music on your smart glasses, and tap your foot to turn the page With our wearables SDK, not only can we render musicXML files on compatible smartglasses, but we’re able to use our smart insoles to trigger page turns by running an @edgeimpulse.com model that detects foot taps on device
Brilliant Sole@brilliantsole.bsky.social · 5mo agoVisualizing pressure and motion data from our smart insoles on smart glasses With our wearables SDK we can receive realtime pressure and motion data from our smart insoles, and then display them on compatible smart glasses (in this case the Brilliant Labs’ Frame running custom firmware)
Visualizing pressure and motion data from our smart insoles on smart glasses With our wearables SDK we can receive realtime pressure and motion data from our smart insoles, and then display them on compatible smart glasses (in this case the Brilliant Labs’ Frame running custom firmware)
Brilliant Sole@brilliantsole.bsky.social · 5mo agoVisualizing jump height on smart glasses With our wearables SDK, we’re able to calculate short-range positional displacement using imu data from our smart insoles & motion modules, visualizing the trajectory on compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
Visualizing jump height on smart glasses With our wearables SDK, we’re able to calculate short-range positional displacement using imu data from our smart insoles & motion modules, visualizing the trajectory on compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
Brilliant Sole@brilliantsole.bsky.social · 6mo agoWork out with realtime feedback on your smartglasses With our Wearables SDK, we can visualize imu data from our motion modules (which can be mounted on the wrist or ankle depending on the workout), guiding the user to perform reps at a controlled tempo for maximum effectiveness
Work out with realtime feedback on your smartglasses With our Wearables SDK, we can visualize imu data from our motion modules (which can be mounted on the wrist or ankle depending on the workout), guiding the user to perform reps at a controlled tempo for maximum effectiveness
Brilliant Sole@brilliantsole.bsky.social · 6mo agoRunning an Image Classifier on smart glasses, using @edgeimpulse.com to create the model
Running an Image Classifier on smart glasses, using @edgeimpulse.com to create the model
Brilliant Sole@brilliantsole.bsky.social · 7mo agoStreaming smart glasses camera data to a Quest 3 Using our Wearables SDK, we’re able to stream images from the Omi Glass (based on the @seeedstudio.com XIAO ESP32-S3 running custom Firmware) to a Quest 3
Streaming smart glasses camera data to a Quest 3 Using our Wearables SDK, we’re able to stream images from the Omi Glass (based on the @seeedstudio.com XIAO ESP32-S3 running custom Firmware) to a Quest 3
Brilliant Sole@brilliantsole.bsky.social · 9mo agoLocal AI Assistant on Smart Glasses Using our wearables SDK to take a picture, speak a prompt with Whisper’s speech to text, and use chrome’s Prompt API to generate a response to be displayed back on the glasses’ display
Local AI Assistant on Smart Glasses Using our wearables SDK to take a picture, speak a prompt with Whisper’s speech to text, and use chrome’s Prompt API to generate a response to be displayed back on the glasses’ display
Brilliant Sole@brilliantsole.bsky.social · 10mo agoSpotify Player with Lyrics on Smart Glasses Using our Wearables SDK to experiment with a music player on compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware) Also using a Mudra Band and TapXR for hand controls
Spotify Player with Lyrics on Smart Glasses Using our Wearables SDK to experiment with a music player on compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware) Also using a Mudra Band and TapXR for hand controls
Brilliant Sole@brilliantsole.bsky.social · 10mo agoRealtime maps in your smart glasses Using our wearables SDK to display a simple map overlay, using @openstreetmap.bsky.social data to retrieve nearby data
Realtime maps in your smart glasses Using our wearables SDK to display a simple map overlay, using @openstreetmap.bsky.social data to retrieve nearby data
Brilliant Sole@brilliantsole.bsky.social · 10mo agoRecognize people with smart glasses Using our wearables SDK to look for certain people, and displaying relevant information when someone is recognized Works with compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware)
Recognize people with smart glasses Using our wearables SDK to look for certain people, and displaying relevant information when someone is recognized Works with compatible smartglasses (in this case the Brilliant Labs’ Frame running custom firmware)
Brilliant Sole@brilliantsole.bsky.social · 10mo agoExperimenting with hand controls on smart glasses With our Wearables SDK, we can both display a 3d wireframe scene on compatible smartglasses, as well as control a cursor by strapping one of our motion modules to our wrist We’re able to detect pinches by running an @edgeimpulse.com model
Experimenting with hand controls on smart glasses With our Wearables SDK, we can both display a 3d wireframe scene on compatible smartglasses, as well as control a cursor by strapping one of our motion modules to our wrist We’re able to detect pinches by running an @edgeimpulse.com model
Brilliant Sole@brilliantsole.bsky.social · 10mo agoView yourself in the third person with smart glasses Using our Wearables SDK, we’re able to visualize MediaPipe tracking data (body, hands, and face) on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) Great for yoga, working out, dancing, etc
View yourself in the third person with smart glasses Using our Wearables SDK, we’re able to visualize MediaPipe tracking data (body, hands, and face) on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) Great for yoga, working out, dancing, etc
Brilliant Sole@brilliantsole.bsky.social · 11mo agoTranslation on Smart Glasses Added foreign language support to our Wearables SDK, allowing us to display languages like Chinese, Japanese, and Korean In this case we’re using @hf.co models for both realtime transcription and translation - all done locally (no cloud required)
Translation on Smart Glasses Added foreign language support to our Wearables SDK, allowing us to display languages like Chinese, Japanese, and Korean In this case we’re using @hf.co models for both realtime transcription and translation - all done locally (no cloud required)
Brilliant Sole@brilliantsole.bsky.social · 11mo agoBoxing on smart glasses Added wireframe support to our Wearables SDK, allowing us to display realtime 3d graphics (like A-Frame and @threejs.org) on compatible smart glasses (in this case the Brilliant Labs Frame)
Boxing on smart glasses Added wireframe support to our Wearables SDK, allowing us to display realtime 3d graphics (like A-Frame and @threejs.org) on compatible smart glasses (in this case the Brilliant Labs Frame)
Brilliant Sole@brilliantsole.bsky.social · 11mo agoRealtime Subtitles on Smart Glasses, using our Wearables SDK We used @hf.co’s Whisper model to transcribe microphone data locally, and then display the transcription on the smart glasses’ display (in this case the Brilliant Labs’ Frame) - no cloud required
Realtime Subtitles on Smart Glasses, using our Wearables SDK We used @hf.co’s Whisper model to transcribe microphone data locally, and then display the transcription on the smart glasses’ display (in this case the Brilliant Labs’ Frame) - no cloud required
Brilliant Sole@brilliantsole.bsky.social · 12mo agoAdded sprite support to our wearables SDK Great for stuff like emulating 3d graphics via billboarding
Added sprite support to our wearables SDK Great for stuff like emulating 3d graphics via billboarding
Brilliant Sole@brilliantsole.bsky.social · 12mo agoAdded Font support to our Brilliant Sole Wearables’ JavaScript SDK
Added Font support to our Brilliant Sole Wearables’ JavaScript SDK
Brilliant Sole@brilliantsole.bsky.social · 12mo agoAdded Bitmap support to our Brilliant Sole Wearables’ JavaScript SDK