are blessed with an extra sense of perception. A faculty of subtle awareness
not explicable which involves perception of constantly changing environment but
also its relation to ourselves. It involves the idea
of receiving information without using any of the other five senses; nor is it
taken from any experiences from the past or known. Sixth Sense frees
information from its confines by seamlessly integrating it with reality, and
thus making the entire world your computer.
Sixth Sense in the
MIT group of a few graduate students came up with an idea to integrate the
digital world into the human world and get easy access to information without
having to put in too much effort like taking out the phone and searching the
internet – they made a wristband that would read the Radio Frequency
Identification tag to find out some information. For example, this wristband
could read the RFID tag of a book that the user is holding in his hand.
They also had a ring that used infrared to communicate
with the smart shelves in supermarkets that would give information about
products. If suppose we pick some item from the market, the ring would glow red
or green indication some information about the product depending on whatever
criteria we program into the system. The motive was to make information more
useful to people with minimal effort without any behaviour changes. The
wristband was a good idea, but it was not completely satisfying the main motive.
this, a larger projector was mounted on a helmet for displaying information,
but this became problematic since if the user would turn to talk to a friend,
the data would project on their face.
Sixth sense in the
sixth sense device is switched to a neck piece which is smaller and more
efficient. It consists of a pocket projector, a mirror and a camera. The technology is based on
recognition of hand gestures, capture-process and manipulation of images. The user wears a neck piece which has a
projector and camera linked to a mobile computer like a phone or such device in
the users’ pocket. Basically, the projector projects on any surface, it carries
the information stored in it and it also collects information from the web.
In the end, the user behaves like a computer and their hands and fingers are
like keyboard and mouse.
prototype was built from an ordinary webcam and a battery-powered 3M projector,
with an attached mirror — all connected to an internet-enabled mobile phone.
The projector helped display all information on any surface. Few coloured
marker caps (red, blue, green, yellow) were worn in 4 different fingers that
helped in recognizing hand gestures.
WORKING OF SIXTH SENSE TECHNOLOGY
The hardware components
that make up the sixth sense device are:
The camera is used to
capture and recognize objects in view and track the user’s hand gestures using
computer-vision based techniques.
image/gesture captured is sent to the mobile device. The camera recognizes everything
around the user and with the help of the micro projector, it can display the
information on any surface, even on the user’s hand.
role of the projector is that of interaction and sharing. The projector
contains a battery inside, with 3 hours of battery life. The projector projects
information by using different surfaces as interfaces. The action of projector is to make it look
like the user is projecting information by touching something. A
tiny LED projector is used to display data sent from the smart phone.
2.1.3 Colour Markers:
These are placed at the tip of the user’s fingers.
Marking the user’s fingers with red, yellow, green, and blue tape helps the
camera recognize gestures. The movements of these coloured markers are
interpreted into gestures that act as instructions for the projected
2.1.4 Mobile Device:
mobile device is used to transmit and receive data anywhere and to anyone via
the mobile internet. The mobile in the sixth sense device helps connect to the
internet and access information from it. It processes the image sent to it and
projects the necessary information.
DOES IT WORK?
Sixth Sense device is a pendant like
structure which is like a mobile wearable interface.
It has a camera, a mirror and a projector
and is connected wirelessly to a Bluetooth or Wi-fi network on a mobile device.
The camera captures images and gestures.
Information from the camera is sent to the mobile
device for processing.
The projector projects the output image on
to any desired surface.
Thus, digital information is freed from
its confines and placed in the physical world
All the components are joined together to form a neck
piece. The camera is used to recognize individuals, images and gestures that is
made, and the projector’s role is to assist in projecting the information on
any surface. Coloured caps are used on the user’s fingers to identify the
gestures and to make it easier for the software to differentiate fingers.
software analyses the data caught by the camera and tracks the locations of
coloured markers by using computer vision techniques. Any number of hand
gestures can be used provided they are all reasonably identified and
differentiated for the system to understand and interpret it. This is possible
only because the Sixth Sense device supports multi-touch and multi-user
sense technology gives the idea of not only what someone is interacting with
but also how they are interacting with it. The role of the software is to
search the internet for information related of some object that is relevant to
the situation and then project it with the help of the projector.
are 3 kinds of gestures that this software recognizes:
gestures – it is where the user touches the screen and makes a certain
application move by pinching or dragging. For example, in Map application.
ü Freehand gestures – usual gestures used, like
the one used to take a picture.
gestures – drawing an icon in the air.
The technology is mainly based on hand gesture
recognition, image capturing, processing, and manipulation. The user can
navigate a map displayed on any surface using hand gestures by a map
application. Users can zoom in or zoom out of an image using hand movements.
Drawing application lets users draw on any surface by tracking the fingertip
USING SIXTH SENSE AS A PLATFORM
various technologies which has been using sixth sense technology as its
Radio Frequency Identification (RFID)
Whirlpool Washing Machines
Sixth sense gives a platform for RFID based intelligence
that combines RFID events with information from other systems and sensors to
make inferences about people, objects, workspaces and their interactions
Radio Frequency Identification is an electronic
tagging technology that allows detection and tracking of tags and thus the
objects that they are affixed to. The sixth sense gadget can select a product
either by image recognition or radio frequency identification (RFID) tags and
idea of Sixth Sense is to use Radio Frequency Identification technology along
with a bunch of other enterprise systems that tracks user activity. Sixth sense
incorporates algorithms that gives a range of undifferentiated tags and
automatically infers a range of information based on the observations. The
technology can automatically differentiate between people tags and object tags,
learn the identities of people, infer the ownership of objects by people, learn
the nature of different zones in a workspace (e.g., private office versus conference
room), and perform other such inferences.
By combining information from these diverse sources,
Sixth Sense records all tag-level events in a raw database. The inference
algorithms consume these raw events to infer events at the level of people, objects,
and workspace zones, which are then recorded in a separate processed database.
These databases can be polled together by running SQL queries.
washing machines is a remarkable application that incorporates the use of sixth
sense technology. Whirlpool’s 2009 range of washing machines have this
technology integrated in them. Sixth sense in washing machines provide more
optimisation of resources and is also efficient in terms of energy, time and
water. It can detect stubborn stains and adjusts wash impact.
The sixth sense washing machines helps to protect
the environment and reduces electricity bills. They are energy efficient and
are capable to adapt their performance to better suit the users’ needs. All
Whirlpool washing machines using sixth sense technology works on three
principles: Sense, control and adaption, to ensure optimal performance.
sixth sense device has a variety of applications. The following are a few of
Making a call
Creating multimedia reading experiences
Getting product information
Getting book information
Getting flight updates
Feed information about people
SIXTH SENSE TECHNOLOGY IN RETAILING
is always something that triggers our senses to connect to something particular
in a store. It may be a flash of colour, a soothing sound or a powerful scent. Retailers
are working hard to make the customers happy and satisfied with what they’ve got
applications and digitization are reshaping the way retailers engage with
customers and how customers prefer shopping. IBM Watson has been working with
major retailers such as North Face and Macy’s to empower their shopping
experiences with visual recognition and sixth sense to enable more personalized
service. They use in-store cameras and sixth sense to monitor the movement of
products and then use the information to optimize promotions. ‘Affectiva’, an
MIT backed company uses facial recognition technology to analyse human faces
and can sense up to 7 human emotions., including anger, contempt, sadness, joy,
surprise, fear and disgust and 20 facial expressions, age, ethnicity and
gender. This database provides valuable insights to retailers about customer
camera in sixth sense device has
the ability to simultaneously scan and analyse hundreds of points of a person’s
face. It can also decipher between human objects and non-human. Via an
instantaneous recognition of facial detection, emotion detection, demographic
and feature detection, computer vision is layering in context to who is
interaction by adding in the how and the why.
This can be implemented in every
area of retailing:
user can pick up a product in shop (e.g. dishwasher liquid), and the system
could display related information back on the product itself.
system can recognize any book picked up by the user and display its rating,
about the author, synopsis on the book cover. It can also display additional
information such as reader’s comments
and also if any of their friends have read it.
system is able to recognize people by their appearances and project a word
cloud of related information retrieved from the internet on the person’s body.
credit card processing after sale.