An IoT wearable for the MIT 40Hz studies

[Slider2732]

Prompted for posting by the MIT 40Hz studies for Alzheimer sufferers, this device is working and running in prototype form. It may offer a route for brainwave data collection and livestreamed uploads for the assistance of human trials.
Also real time sensor graphing on its display and simple ease of use by users/patients.
With further development, it was intended to form an Indiegogo campaign, but funding from other sources might be the better route to move it along quickly.
Muse brainwave headset connectivity is one aim ( https://www.youtube.com/watch?v=GYO_WC7TE4c )
Needed, are a 3D printer for the plastics of a housing. A touch display and other screen types to assess. ESP8266 and ESP32 modules for prototyping and destruction/limits testing. Lipo's, charge circuits, various externally connected hardware. Standards compliance.  All of which are hopefully well explained below.




The Universe

The Universe connects everything together.
It's an internet connected wearable device, worn like a watch.
Not just a SmartWatch and needs no cellphone to connect to it, the aim is to deliver useful information.
It also has the ability to connect to external slim devices called 'Satellites' - for I/R TV remote control, flashlight, bluetooth headphones, listen to radio, use a microphone, camera, or even connect an internet controlled laser !
It connects to popular websites, allows IoT (Internet of Things) functionality and, of course, plays games 


Functions included so far and running:
Connection to home WiFi or any WiFi free access Hotspot
Analog and digital time displays
Accurate internet time
Connectivity to Thingspeak data logging and display
Wunderground local weather conditions
Twitter message posting
Webpage host and server - allowing IoT functions and ability to change device settings from a PC, phone or tablet
Direct output port for controlling magnetically attached 'Satellites'
Playable games
Many more extras, such as lap timer, alarm, countdown timer...useful functions
Good audio level onboard sound
Identifies itself as The_Universe on WiFi networks
Will run offline, with reduced functionality

Latest inclusions -
FastBoot, directly connect to home WiFi network at switch on
WiFi Hotspot connectivity
Laser Satellite
Flappy Bird game
Reaction! game
PONG game

To be implemented -
Skype variant
VNC viewer
Touch screen
Speech recognition and speech output
Perhaps sensors and 40Hz output for the MIT trials
Downloadable Apps
ESP32 for Bluetooth 4.0 integration and WiFi power scaling (power usage)
A better eye candy screen output, more in line with modern O/S's
More games


Hardware Specs:
ESP-12E WiFi processor and CPU, running at 80MHz/160Mhz
4MB flash memory
Onboard SPIFFS 3MB file system for data storage
ST7735 TFT 262K colour screen
Small loudspeaker, not a tinny piezo disc
Satellite magnet based output connectivity port
Satellite output indicator LED
250mA lipo battery for on and off all day use 
Charging connector
Firmware updates connector (later to be OTA (Over The Air))
Adjustable good quality metal strap



Here is a demo video of the 2nd prototype, with footage added of the Laser Satellite in operation as a PWM audio sender and footage of the original prototype, to explain more of the features.

https://www.youtube.com/watch?v=53biIs61usk
11mins 30sec..a big video, of a small device.

[Centraflow]

Wow, you made that Mark? well done

Regards

Mike

[muDped]

Yes indeed!  That is an impressive looking device.

Brings to mind Dick Tracy's wrist radio from the
long ago comic strip;  but much improved and brought
up to date with modern technology.

The Story

[Slider2732]

Thanks guys.
Sorry for the delay in response, have just got a VNC client running on it. It's the ability to stream a connected PC, tablet or cellphone screen to the device, for Skype mainly, but I was watching a YouTube video on it just now.
Only video at the moment, no audio...for watching silent movies perhaps lol. But if an audio section can be integrated then video and audio can be received. After that, a camera and mic for a proper Skype experience.
The O/S is intended to be radically changed, once a touchscreen can be afforded.

Yep, early days, 4 months worth mind you and a lot of learning, but is coming along and funnily enough a friend said the same - Dick Tracy !
The fact that it's only taking shape is what heavily interests me in a fork of direction for the 40Hz studies. 
There are quite a few Smart watches out there now, some of which are quite excellent, so this has to deliver something different to have any appeal.
IoT and the Satellites (such as the laser) are that something new and the MIT studies are a great match for not being able to put it down and forget where it is ! The VNC section would allow patient/Doctor communication while performing experiments and tests. A wireless headband with sensors, plus live data both on The Universe and transmitted for MD study completes the picture.

[Slider2732]

Couple of pics of the VNC viewer running and a few seconds demo video

https://www.youtube.com/watch?v=Nhr_SKioGck

[JimBoot]

That's really awesome mark. Very impressive.

[Slider2732]

Thanks Jim,
Am hoping a head sensor setup can be implemented so am looking at circuits for that. The idea is a wireless headset that transmits info to The Universe, which itself displays that info and uploads to a cloud service. Less wires means less hassle for the patient.
It would be so good to get something sorted for your Dad...and your own work has been cool to watch over the past few days.

[Itsu]

I agree, very awesome.

I would expect that companies would line up at your doorstep for more information on it soon.

Itsu

[Slider2732]

Very kind, thanks Itsu

Audio with video over VNC seems to be very rare.
So there's a simple and truly basic method of audio sending now..using just a 27MHz 4 leg crystal and a transformer. It plugs in to a USB port on the PC for power and into the speaker jack for audio. The crystal modulates the frequency, such that any radio will pick it up on 108MHz, top of the FM band, 4x 27Mhz.
As such, audio and video can now be transmitted....going the other way will be more difficult !
Range is across the house, but the antenna for transmission is purposefully only 12" long, keeping FCC broadcast rules in mind.

Here's an example circuit of the 27MHz crystal method:
http://makerf.com/posts/fun_with_crystal_oscillators_part_2