Today’s teleconferencing systems can be improved by using advanced tracking systems and signal processing techniques. Commonly-available solutions do not track the movement of the person or consider the characteristics of the room in which the conversation is conducted. Typical systems require that the person is either seated directly in front of the camera or standing very close to, so as to be within range/view, of the microphone/camera. However, this arrangement restricts the speaker’s freedom of movement and may be inadequate if the speaker moves about the room while delivering the message. The lack of speaker tracking results in a diminished telecommunication experience for both the speaker and audience.

Team Pulse’s project is the Intelligent Video Audio Conferencing System (IVACS). Our aim is to develop a low-cost prototype signal processing system that is able to track a moving person in a moderately-sized room using both sound and video information, and subsequently direct the conversation to an audience. The system will be constructed using a standard Laboratory PC and commonly-available off-the-shelf equipment. Devices such as the video camera, microphones and speakers will act as the “eyes”, “ears” and “mouth” of the system. The PC platform, coupled with our custom application, will implement the signal processing algorithms and provide the processing power for real-time operation. The project is to be completed within 24 weeks to a budget of no more than AUD $1,000.

The IVACS system will be able to create a more immersive telecommunication experience for users by directing the conversation to a moving person, allowing them the freedom to move about whilst maintaining optimal communication feedback. The IVACS has potential applications in a variety of teleconferencing and focused-presentation scenarios. The low-cost and simplicity of IVACS would make it an attractive solution to businesses and consumers alike. We envision that the system will work across many remote sites, imperviously networked together via the Internet. From board rooms, to lecture theatres, to our living rooms, IVACS will allow people to collaborate and communicate with each other quickly and easily, without borders.

Team Pulse would like to acknowledge the generous support from Panasonic Australia and Microsoft Australia. Panasonic is a market leader in home and commercial electronic solutions. Microsoft Australia is global leader in software solutions. Both organisations have donated tools that will be used extensively in this Project.

If you are interested to enquire about any aspect of this Project, including sponsorship and commercialisation opportunities, please direct all correspondence to the Project Manager: wanga7@lycos.com

Andrew Browne, Hao Chen, Bo Chen, Alex Wang
Dr. Brian Krongold, Dr Jamie Evans