Introduction: Infigo - ( an Artificial Intelligence Powered Wearable Glove )
Infigo is an AI (Artificial Intelligence) powered wearable glove based on the principles of Assistive Technology (AT) which will enhance the productivity of the impaired society
Artificial Intelligence and Machine Learning cannot replace a human intellect but can possibly inflate the output by it's assistive interface.
As Elon musk asserted, "If humanity is to survive the advent of artificial intelligence, it needs to upgrade"
In this era of blooming innovations, we hardly see any gadget or a product empowering the disabled, rather making luxurious products for the general society.
- This Glove will empower the visually impaired by an assistive and adaptive feature of a standalone phone with embedded keypad on the tips of your finger on the basis of the India style of counting numbers on tips.
- The user will be able to talk to the latter on the phone by just bringing his thumb (with in ear speaker ) near his ears and the pinky finger (with mini mic ) near your mouth to talk without any hassle of talking out the phone and handling it for a long time.
- This will enhance and resolve the problems faced by the visually impaired while using a phone.
- Not only a phone, it is powered by some of the bandwagons of AI (virtual assistant) i.e Alexa (Amazon AVS) and Google assistant (Google API), which will enable the user to control and access the world through their voice.
- The user can order food, book cab, check weather, converse with assistant, make reminders, alarms and much more with AI on the board. The user can listen to songs by connecting it to external speakers and enjoy audio books as well !
- The user can simply control their smart home appliances through their voice, with the help of two smart assistants running simultaneously on board.
Step 1: Building the Integrated Phone
As we know that we can develop a phone with an Arduino and a GSM module, but to make it more sleek, I used a pcb of gsm phone module and attached the keypad keys with the conductive thread to the finger tips by stitching them in the gloves.
By attaching them to the fingertips, I ensured that the two wires and not attached, as to make incomplete circuit, which would only get complete once the metal cap on the thumb presses that and circuit gets complete, pressing the respective number.
I managed to drop the weight of glove by using the conductive thread instead of comparatively heavier copper wires. Enabling comfortable experience.
Step 2: Embedding PCB With Keypad on the Glove
Materials Required :
1. PCB of GSM phone
2. Conductive thread
3. A Glove
and some soldiering skills.
I managed to open an small and sleek keypad phone, and acquiring the main board of it for my project.
After opening it and removing the conductive small switches pasted on the main copper component which when connected dials a number.
You will see two small circular copper layers separated with a black thin lining. So when those two layers meet a respective number is dialed.
So, bringing the same thing on you fingertip through conductive threads was my idea.
Step 1 :
Solider the conductive thread to the copper components on the PCB properly (avoiding yarns reaching out to other wires)
Step 2 :
After soldiering, stitch the thread through your glove and make a lump of thread on the tips of you glove leaving some space in between, so that it doesn't get in contact with each other.
Step 3 :
After stitching all the keypad threads, Stitch a metal cap (conductive) on the tip of you thumb - which will act as our switch.
Step 4 :
Expand the wires of the In ear speaker and Microphone to the thumb and the pinky finger respectively through conductive thread.
Apparently, the first phase of my project is completed by making a standalone phone embedded on my glove.
Step 3: Installing Alexa and Google Api on a Rasberry Pi (working Simultaneously)
1. Rasberry Pi 3 (Model B)
2. 16GB ( class 10 SD CARD)
3. Rasbian OS (NOOBS)
4. A USB MIC
5. A wireless mini speaker
6. HDMI CABLE, Wireless keyboard and mouse (in order to access and code rasberry pi
7. Google SDK
8. Amazon Alexa voice service
Download credentials--->.json file (refer to this doc for creating credentials https://developers.google.com/assistant/sdk/devel... the .json file in/home/pi directoryRename it to assistant--->assistant.json
Step 4: INSTALLING NOOBS ON THE RASBERRY PI
You’ll first need to set up your Raspberry Pi. To do so :
- Download the NOOBS Package
- extract it to your micro SD card and plug it into your Raspberry Pi.
- Connect the USB Keyboard, Mouse, Mic and the Speaker to the Pi and turn it on.
- You will now get a first time setup.
- Simply select Debian and install to start the installation of Debian on your Raspberry Pi.
Step 5: Creating You Amazon Developer Account
Then, you need to create your Amazon Developer Account and create a security profile. You can follow these instructions to do so :
Login to Amazon Developer Portal - developer.amazon.com
Click Alexa -> Alexa Voice Service -> Get Started.
Click Create Product.
Fill-in these values and save:-
1. On this page you'll provide information about your product.
2. Product Name - This is what gets displayed to users when they register an instance of the product with Amazon.
3. Product ID - A simple identifier for your product. When asked if your product is an app or device, select Device.
4. When asked if your product will use a companion app, select Yes. For Product Category, select Other, and enter "Pi Project". Note:
5. For a commercial product, you should select the best option available.
6. Enter a brief description. For example: My first Pi project.
7. When asked how users will interact with your product, select Touch-initiated and Hands-free. Note: For a commercial product, you should select the options that best describe your product's functionality.
8. You can skip uploading an image for now. This content is used on the manage your content and devices screen on amazon.com.
9. When asked if you will distribute this project, select No. Note: For a commercial product, you should select Yes.
10. When asked if this product is for children, select No.Click Next.
Security Profile On this page we'll create a new Login with Amazon (LWA) security profile.
This associates user data and security credentials with one or more products. Click Create New Profile.
- Enter a name and description for your security profile, then click Next.
- For example: Security Profile Name: Alexa Voice Service Sample App Security Profile. Security Profile Description: Alexa Voice Service Sample App Security Profile Description.Note: These are suggested values. You provide custom information for Security Profile Name and Security Profile Description.
- A Client ID and Client Secret will be generated for you.
- Enter your Allowed origins and Allowed return URLs.
- We need to setup http and httpsroutes for our sample project: Allowed Origins: Click "Add Another" and then enter http://localhost:3000 in the text field that appears.
- Then click "Add Another" and enter http://localhost:3000 Allowed Return URLs: Click "Add Another" and then enter http://localhost:3000 in the text field that appears.
- Then click "Add Another" and enter http://localhost:3000 Update.
- You are now ready to generate self-signed certificates.
- Enable Security Profile Open a web browser, and visit http://localhost:3000 Near the top of the page, select the security profile you created earlier from the drop down menu and click Confirm.
- Click Save.
Step 6: Create You Google Developer Account
Then, Create a Google developer account, and enable the Google API (Application programming interface).
Step 7: Pre-Installation Approach
Before Starting the setup :
For Google Assistant
1. Download credentials-.json file (refer to this doc for creating credentials)
2. Place the .json file in/home/pi directory
3. DO NOT RENAME THE JSON FILE
For Amazon Alexa
1. Create a security profile for alexa-avs-sample-app if you already don't have one. Now, run the following commands one by one to clone the GitHub project and make the installer files executable:
-- git clone https://github.com/shivasiddharth/Assistants-Pi
sudo chmod +x /home/pi/Assistants-Pi/prep-system.sh
sudo chmod +x /home/pi/Assistants-Pi/audio-test.sh
sudo chmod +x /home/pi/Assistants-Pi/installer.sh
First, OS will be updated and upgraded. Thereafter, you will be prompted to select the audio setup. Select “3” from the options. Now, restart the Raspberry Pi.
Step 8: Installing Alexa and Google Assistant
After testing the speakers through audio test by writing :
Then It's time to install Alexa and Google assistant on the pi
when your system is ready, write the following command to start the installer/setup :
Step 9: Controlling Smart Home Appliances Through Infigo
With the growing use of iot and artificial intelligence in our day to day life, we are heading towards to a new generation with the advent of hi-technology.
In order to let my glove stand in such world, I added Smart home control feature to it with the help of IFTTT.
Materials Required :
1. Infigo Glove with rasberrry pi and Alexa and Google on board
2. Four channel relay board
3. IFTTT app (integrated with alexa and google)
4. A LED bulb
We have a be nice policy.
Please be positive and constructive.