Smartwatch-Like HID With Keyboard And Touchpad

– Commercial –

Think about a smartwatch whose show acts as an interface serving you each as a keyboard and a mouse! What if I inform you that it’s simply potential.

Beforehand, in March 2023 subject, we revealed a mission for a smartwatch with an ESP32 board that includes Wi-Fi evaluation and well being monitoring capabilities. Constructing upon this, allow us to now create a smartwatch that may perform as a wearable human interface gadget (HID). This watch can function each a keyboard and a mouse, offering management over telephones, laptops, and so forth. It acts as a conveyable keyboard with mouse performance, worn on the wrist.

– Commercial –

This design utilises the board referred to as Indusboard coin together with GC9A01 driver and CST816S capacitive contact driver-based show, completely suited to a spherical show. The show is related to the Indusboard utilizing SPI and I2C pins onboard. Check with Fig. 1 for the creator’s prototype. The elements required for this gadget are listed in Invoice of Supplies desk.

Software program coding

The code is created utilizing Arduino and the TFTeSPI library, with the CST816S contact driver library driving the show and touchscreen. The HID library comes pre-installed with the ESP32S2 Board SDK, so solely TFTeSPI and CST816 libraries have to be put in. Seek for them within the Arduino library supervisor and set up. Configure the show driver and SPI pins within the TFTeSPI library folder discovered within the Arduino library folder. Open the person config file for the library and uncomment the GC9A01_Driver. Set the MISO, MOSI, CS, and DC pins within the configuration file. Check with Figs. 2 and three for settings.

Now, two codes have to be written: one for the touchpad mouse and the opposite for the keyboard.

Code for touchpad mouse. For the mouse, embody the mouse HID library and outline the I2C pins for the show. Any pin on the Indusboard can be utilized because the I2C pin. Right here, the pins 5 and 6 are used as SDA and SCL for I2C pins. Within the code, map the contact factors with mouse actions and use gestures like left swipe, proper swipe, single faucet, and double faucet for mouse clicks. Check with Figs. 4 and 5 for code snippets.

Code for keyboard. Embody the HID library for Indusboard and set the I2C pins of the contact show driver. Any pin on the Indusboard might be configured as an I2C pin. Right here, the pins 5 and 6 are used. Check with Fig. 6 for code settings.

Create the keyboard structure, show it on the keyboard, map the touchpoints to the displayed keys, and detect contact on these keys. Then, ship that letter as HID enter to the laptop computer. Check with Fig. 7 for the code snippet for the keyboard. Fig. 8 exhibits the code snippet to detect the contact level and ship as HID enter.

After together with all of the libraries, add the code by deciding on the ESP32S2 because the chip and the correct port.

Circuit diagram

Join the show and contact pins in line with the circuit diagram proven in Fig. 9. Solder the pins behind the Indusboard. The Indusboard dimension suits completely behind the show like a watch. Check with Fig. 10 for soldering and placement of the Indusboard.

Testing

After correct meeting, energy the Indusboard. When the code for the keyboard is uploaded, it exhibits the keyboard structure, and touching the keys will sort the corresponding alphabets and letters. When the code for the mouse is uploaded, shifting a finger on the show will transfer the mouse pointer together with the contact actions. Check with Fig. 11 for the creator’s testing of the smartwatch contact keyboard.