farmin1923/vr-self-driving-car

I am developing a VR based self-driving car simulator for using it as a testing bed for predicting pedestrian intention. Also made a multi-player server and animated an avatar for synchronizing VR-input action with Unity 3D input.

VR Based Self-Driving Car

I am developing a VR based self-driving car simulator in Unity 3D for using it as a testing bed for predicting pedestrian intention. VR simulators are recognized for their affordability, and adaptability in producing a variety of traffic situations, and it is more reliable to conduct human-factor research in autonomous cars. I have made a multi-player client-server where the car and the pedestrian input can be controlled from different systems. Also, animated an avatar and write scripting for synchronizing VR-input action with Unity 3D input.

The features that are needed for testing the classifier of Pedestrian Intention Algorithom are the coordinate of top-left and bottom-right coordinates of the pedestrian bounding box and the speed of the car. The extrinsic matrix changes the world coordinate system to the camera coordinate system. Calculating the Skinned-Mesh Renderer of the avatar, the coordinate points of the bounding box were found by this matrix transformation. An UI has been designed which enclosed the pedestrian and changed according to the pedestrian's action.

Camera View of the Client-Server Systems

Egocentric View of the car	Egocentric view of the pedestrian

Demonstration of the Simulator from Driver's Perspective

Server.Demo.mp4

Demonstration of the Simulator from Pedestrian's Perspective

Fina.R03.mp4

Demonstration of Self-Driving Car

Self.Driving.Car.R02.mp4

Avatar of the Pedestrian, Controlled by Keyboard Input

Avatar.mp4