Many people whom others find boring are utterly clueless. They can literally go their whole lives wondering why others shut them out.

This is especially true for those suffering from autism, a condition that renders one unable to discern ordinary cues of emotional response.

Now, MIT Technology Review reports that technology is racing to help people with this social disorder. A new device has been developed that is, in effect, an emotion detector.

This device will alert an autistic user if someone they are talking to begins to get bored or annoyed.

Dr. Rana El Kaliouby of MIT’s Media Lab calls it an “emotional social intelligence prosthetic” device. The system consists of a tiny camera attached to a pair of glasses, a hand-held computer, image recognition software and special software that interprets emotions. When the listener seems bored or annoyed, the computer will vibrate.

The software is able to assess whether someone is in agreement with what’s being said, paying attention, considering the matter, or even uncertain — all from a mere several seconds of video.

Other software can properly detect the basic emotions of happiness, sadness, anger, fear, surprise and disgust. However, the complex states Dr. El Kaliouby’s program focuses on are trickier to identify. They are expressed in a sequence of movements rather than just a single expression.          

A machine-learning algorithm is at the core of the software. It generalizes from video clips of actors demonstrating specific emotions. So far, the software is right 90 percent of the time when assessing actors but just 64 percent of the time with regular people.

El Kaliouby is now training the software on excerpts from movies and footage captured by webcams. This week she plans to gather the first on-the-move training footage by equipping a group of volunteers, some of whom are autistic, with wearable cameras.

Raising the accuracy of recognition is crucial. Additionally, the system requires a high-resolution digital camera that’s small enough and light enough to be worn comfortably. It is also a computing-intensive, so proper real-time applications may require a few more doublings of computer power. All of these challenges should be met in the next five years.

The team will present the device next week at the Body Sensor Network conference at MIT. People with autism are not the only ones who stand to benefit. Timothy Bickmore of Northeastern University in Boston, who studies ways in which computers can be made to engage with people’s emotions, says the device would be a great teaching aid. “I would love it if you could have a computer looking at each student in the room to tell me when 20 percent of them were bored or confused,” he explained.

There is preliminary evidence that women are better at distinguishing emotions than men. In a study of children, girls displayed greater sensitivity to emotions than boys.

Call it a hunch, but I predict that when this technology is perfected, the biggest market will be husbands wanting to better understand their wives…or wives wanting to help their husbands.

Now let’s consider for a moment a field so new that I must coin a name for it…

Some Social Implications of Nano-Genetic Engineering

Genetic engineering and related fields have been moving forward at a rapid pace since the 1980s. Nanotechnology is just getting started. Apart from its enormous significance in its own right, nanotechnology is equally amazing as an enabling technology. Consider the case of genetic engineering.

Crucial to understanding any organism is a complete breakdown of its structure. While recent developments in DNA sequencing have accelerated this work, much remains to be done. Nanotech will take this to its full potential.

Tiny robots, themselves comprised of a mere handful of molecules, will move painstakingly through any microbiological structure, such as a cell nucleus. They will disassemble it atom by atom, recording what they discover for future use.

Once this has been completed enough times to eliminate any errors or anomalies, scientists and engineers will then have a “blueprint” for that particular microbiological structure. It could be a virus, a type of cell or even a component of a cell.

Subsequently, other nanobots will be able to reassemble the microorganism from its “blueprint,” much as one would do this by following architectural drawings. Not only will they be able to do this, but they will be able to alter and substitute substructures on demand. (Remember, in architecture and manufacturing, the ultimate structure is itself comprised of levels of substructures, each of which has its own blueprint.)

Currently, genetic engineers are fairly adept at cutting and pasting genes from one organism to another. They can even do this between species. What they can’t yet do with any efficiency is modify an existing gene in a precise way upon demand and test that gene right away for its expression.

Nanotech will enable this kind of real-time analysis, which will allow organisms to be crafted in much the same way software is written today. I’m calling it, “Nano-genetic engineering” (unless someone else has previously named it, in which case I’ll cheerfully cede the evanescent rights of naming).

While one can easily envision Frankensteinian scenarios, the uses are, in fact, far more likely to be benign. I predict that by 2014, when the World Health Organization discovers a new viral plague such as SARS, the response won’t be limited to quarantine, but will include immediate development of organisms that provide immunity or cure the disease, without harmful side effects.

Every radical technological development brings both great promise and perils. Yet the solution proffered by noted computer scientist Bill Joy — that humanity forego certain areas of exploration and development because they appear too risky — is greatly mistaken.

Apart from foregoing the potential benefits (imagine if compatriots had prevailed upon Benjamin Franklin to forego his experiments with lightning), such a decision relegates all such research to the backwaters, and the kind of hidden labs populated by terrorists and dictators’ minions.

Thanks, but I’ll take my science out in the open, with a healthy dose of peer review and public awareness. Just as new technologies rush to emerge, so too will ever more advanced systems of protection. Consider, for example, the advent of computer viruses and anti-virus software.

To your profitable future,

Jonathan Kolber
April 05, 2006

Emotional Prosthetics was originally featured in the Penny Sleuth.

[A Note From James Boric:

Below, Jonathan shares the latest breakthrough he’s keeping an eye on. It could soon completely alter the wine industry. But not long after that, it could change everything from how we detect heart attacks to how we pick up dates! Enjoy…]

It’s rare that a technology stretches my credulity. I’ve simply seen too many things become real in the past few years that had looked like science fiction.

His ultimate intent is to create the same sorts of computerized systems with sensors and governors (switches that control activity in a system to keep a variable within acceptable parameters) used in industrial manufacturing processes.

Key to this is the concept that flavor components can be isolated and quantified, much like active ingredients are isolated from wild plants to derive new pharmaceutical drugs. Scientists already know how to do this. What’s new is the notion of modeling their appropriate ratios to determine effect on the human palate.

Under Biegler’s vision, wine would become a standardized industrial product with many thousands of variations. While fermentation is not the only factor of significance, mastering it is exceptionally difficult and will take winemaking a significant distance from art to industry.

I’m not a wine collector, but if I were, I’d cease buying wine as investment and restrict my purchases to bottles I intend to drink.

Assuming this works, it has some significant implications beyond just wine.

With its enormous variety of smells and flavors, wine is one of the most sophisticated sensory experiences known to man. That’s why a bottle of old Lafitte Rothschild can cost thousands of times as much as an ordinary bottle of varietal.

Scent Companies: Smelling Emotional Reactions?

Is the job applicant or prospective business associate seated across the table telling you the truth?

New kinds of medical devices will be able to monitor trace chemicals in the breath. For example, distinctive trace chemicals enter the breath when the body has a heart attack. Someone who has previously had a heart attack may be equipped with such a device to help distinguish a second heart attack from mere indigestion.

It’s easy to envision The Sharper Image selling devices such as these circa 2012. In addition, the potential applications for law enforcement and espionage are myriad.

Technological breakthroughs usually come with some unintended consequences. In many cases, those unintended consequences lead to exciting technology applications that get licensed into early-stage companies. We’ll be watching for them.

To your profitable future,

Jonathan Kolber

January 11, 2006

Scent Companies: Can Flavor Be Reduced to Formulas? was originally featured in the Penny Sleuth.