Embedded Attentive Sensing

Position Title: Research Assistant/summer researcher

Location:  Lassonde 002

Professor: James Elder

Department: Electrical Engineering and Computer Science

Contact for Professor (Email, phone): jelder@yorku.ca

# of positions available: 2

Project Description :

Embedded Attentive Sensing

Video cameras generate massive quantities of data, but using these data effectively requires intelligent software and hardware. Inspired by the human visual attention and oculomotor systems, our laboratory has invented and patented a series of attentive sensor devices that automatically orient an attentive camera to capture the most important details in a scene. Last summer, the applicant, Ryan Dowling, co-invented a new form of this sensor that is even faster and more accurate than our previous prototypes.

A potential application for this sensor is in small battery-powered unmanned aerial vehicles (UAVs). Given limits on flight time imposed by the battery, it can be vital that maximally informative imagery is extracted on each mission. However, to deploy attentive sensing on a small UAV platform, two technical challenges must be addressed. First, the device must be made much smaller and lighter. Second, the attentive sensing control algorithms must be embedded in the onboard processor, as the bandwidth of telemetric links are too limited to support real-time attentive control.

Duties and Responsibilities of the student:

The student will design and build a novel miniaturized version of our attentive sensor suitable for deployment on a small UAV platform, and will port the sensing and control software to the NVIDIA Jetson TK1 platform to allow the attentive sensor to be operated autonomously without telemetric control.

Skills and Qualifications:

1.      Algorithm design

2.      Programming in C++ and MATLAB

3.      Systems hardware/software design

4.      Embedded systems design

5.      Ability to work in a team

Degrees, courses and Disciplines prerequisite*:

EECS students (CS, CE, EE) or students with strong programing and mathematics skills preferred.

Stipend : TBD

Duration:  16 weeks minimum

Start Date:  05/01/2018 (estimated)

End Date:  08/31/2018 (estimated)

If you are interested in this research project, please contact Dr. James Elder at jelder@yorku.ca