ahuer2435/dms

Driver Monitoring System

DMS

Driver Monitoring System

Updates Histopy

• v0.0 : Initial version [Released Date : 2021-07-01]
• v0.1 : CAN signal update [Released Date : 2021-08-20]
• v0.2 : HMI & odometer update [Release Date : 2021-09-13]
• v0.2.1 : Audio synchronization test branch [Release Date : 2021-09-30]
• v1.0.0 : Real-time traffic info & GNSS (RTK) [Release Date : 2022-10-07]
• v1.1.0 : Front-view external video (Internal camera is a temporary suspension) [Release Date : 2022-12-27]
• v1.2.0 : Replace the internal cameras with the RealSense Cameras [Release Date : 2023-03-31]
• v1.3.0 : Add left & right indicator signals to CAN signal [Release Date : 2023-04-10]

Build environments

• sudo apt install ffmpeg

Data application lists

• External Video
  • RGB images of front view towards the vehicle heading (.png)
• Internal Video
  • RGB images of front view towards the driver (.png)
  • IR images of front view towards the driver (.png)
  • Depth images of front view towards the driver
  • RGB images of side view towards the driver (.png)
  • IR images of side view towards the driver (.png)
  • Depth images of side view towards the driver
• CAN data
  • A_Depth : Accel Pedal State (%)
  • B_Depth : Brake Pedal state (%)
  • B_PRES : Brake Presure (TBD)
  • B_FLAG : Brake Operation Flag
  • S_Angle : Steering Wheel Angle (^o)
  • HL_High : Headlamp High-Beam Operation
  • HL_Low : Headlamp High-Beam Operation
  • DriveMode : Drive Mode
  • HevMode : Hybrid Mode
  • E_Status : Enine Status
  • E_Col_Temp : Engine Coolant Temperature (^oC)
  • E_Speed : Engine RPM (rpm)
  • F_Consump : Fuel Consumption (TBD)
  • Eco_Level : TBD
  • F_Economy : Fuel Economy (km/L)
  • BA_SoC : Battery SoC
  • LAT_ACCEL : Lateral Acceleration (TBD)
  • LONG_ACCEL : Longitudinal Acceleration (TBD)
  • YAW_RATE : YAW_RATE (TBD)
  • WHL_SPD_FR : Vehicle speed on each wheels (Front Right) (kph)
  • WHL_SPD_FL : Vehicle speed on each wheels (Front Left) (kph)
  • WHL_SPD_RR : Vehicle speed on each wheels (Rear Right) (kph)
  • WHL_SPD_RL : Vehicle speed on each wheels (Rear Left) (kph)
  • V_Spped : Vehicle speed (kph)
  • G_Status : Gear Status
  • Inhibit_P : Parking Gear Status
  • Inhibit_R : Reverse Gear Status
  • Inhibit_N : Neutral Gear Status
  • Inhibit_D : Drive Gear Status
  • Out_Temp : Ambient Temperature (^oC)
  • IndLeft : Indicator signal for left
  • IndRight : Indicator signal for right
• Real-time traffic information
  • LinkID : TBD
  • LinkName : TBD
  • Description : TBD
  • Congestion : TBD
  • TrafficUpdateTime : TBD
  • LinkDirection : TBD
  • LinkRoadType : TBD
  • StartNodeName : TBD
  • EndNodeName : TBD
  • LinkLength : TBD
  • LinkPassTime : TBD
  • LinkSpeed : TBD
• GNSS(Global Navigation Satellite System) w/RTK(Real Time Kinematic)
  • Latitude : TBD
  • Longitude : TBD
  • GPSMode : TBD
  • SatelliteNum : TBD
  • Altitude : TBD
  • Yaw : TBD
  • Pitch : TBD
  • Roll : TBD
  • TrueNorth : TBD
  • NorthDeclination : TBD

▼▼▼▼▼▼▼▼ Deactivate data ▼▼▼▼▼▼▼▼ (please refer to config file)

• Driver affective state
  • Affective state of the driver self-reported through the HMI systems.
• Physiological data
  • Temp : Skin temperature (^oC)
  • EDA : Electrodermal Activity (µS)
  • BVP : photoplethysmograph
  • HR : Average heart rate from BVP signal (bpm)
  • ACC : 3-axis accelerometer on wrist band (1/64g)
• Audio
  • Audio acquired from cavin of vehicle(right side of the driver's seat headrest) (.wav)