Driver-in-the-Loop (DIL)

Driver-in-the-Loop (DIL) simulation incorporates a human driver into the testing process using driving simulators. This method is essential for evaluating human-machine interactions, driver behavior, and the effectiveness of advanced driver-assistance systems (ADAS) and automation features.

Key Features

• Real-time driver input integration
• Immersive virtual driving environment
• Support for various input devices (steering wheels, pedals, etc.)
• Integration with ADAS features for human factor testing
• Scenario-based testing capabilities (scenarios are authored by you)

User-Authored Use Cases

You can build DIL driving training, testing, and evaluation missions with the Mission Editor and Flowgraph missions . Flowgraph lets you define mission objectives, conditions, and scoring so you can implement custom driver behavior tests and evaluation logic.

Hardware Setup

Multi-Screen Configuration

BeamNG.tech supports multi-monitor rendering for immersive DIL setups. For best results:

Requirements:

• Use 3 monitors of the same model or type (matching resolutions and dimensions)
• Set the game to Borderless mode in Options -> Display
• Keep Nvidia Surround/AMD Eyefinity disabled

Configuration:

1. Navigate to Options -> Display
2. Enable Multi-Monitor Render
3. Adjust side view angles using the dedicated sliders
4. Press Apply Display Settings to save

3D Screen Option: For enhanced immersion, a 3D screen can be used in the center position of a triple monitor setup. This provides stereoscopic depth perception while maintaining the wide field of view from the side monitors.

Using tech/multiscreen.lua for Custom Viewport Configurations:

For setups with different monitor sizes or custom viewport arrangements, you can use tech/multiscreen.lua to create multiple camera views and windows. This approach allows for:

• Custom viewport configurations (e.g., 2-window, 6-viewport arrangements)
• Support for very high resolutions (e.g., 11520x1080)
• Flexible placement of views across multiple monitors
• Soft edge blending capabilities for front projection setups

Performance Considerations:

• High-end GPUs (e.g., RTX 4090) are recommended for complex multi-viewport setups
• Typical performance: 40-50 Hz frame rates achievable with 11520x1080 resolution on capable hardware
• BeamNG.tech does not support multi-GPU configurations (SLI) - only one GPU can be used at a time
• Attempting to use multiple GPUs or switching GPUs during runtime can cause crashes

Configuration Tips:

• Set up BeamNG.tech for the primary/center screen first
• Add additional camera views for side monitors using tech/multiscreen.lua
• Note that additional views created with tech/multiscreen.lua do not have the full functionality of the main view
• To keep force feedback and sound active when windows are not in focus, go to Options -> Audio and uncheck “Mute when window is not in focus”

For implementation details and community examples, refer to the Rear camera/viewport forum discussion .

High-Resolution Setups (Triple 4K):

For triple 4K monitor configurations, performance optimization is critical due to the high pixel count. Key considerations include:

Performance Optimization Strategy:

• Prioritize center screen detail: Keep the center screen (driver’s primary focus) at a higher level of detail
• Optimize side screens: The side monitors are not the main focus and can be optimized to acceptable performance levels
• Balance graphics settings: Adjust graphics quality, near/far clip planes, and level of detail (LOD) settings to achieve acceptable performance
• Be selective about on-screen content: Be smart about what you show on screen and at what level of detail

Display Considerations:

• Display smearing: If experiencing display-level smearing, consider monitors with low response times
• OLED displays: OLED monitors offer sharp black-to-white transition times and can help reduce smearing artifacts
• Response time: Prioritize displays with low response times for better motion clarity

Future Technologies:

• DLSS (Deep Learning Super Sampling) and DLAA (Deep Learning Anti-Aliasing) have been discussed but are not currently available
• Multi-machine computing has been explored as a potential solution for extreme high-resolution setups

Sim Rig Setup

A proper sim rig enhances the DIL experience and provides consistent testing conditions. Common components include:

Steering Wheels & Bases:

• Fanatec (wheel, base, pedals, shifter)
• Simagic (wheel, shifter, pedal haptics)
• Simucube (base)
• Moza (handbrake)
• Cube Controls (wheel hub)

Configuration Tips:

• Most UX challenges come from setting up hardware in the manufacturer’s software
• Ensure proper driver installation and calibration
• Configure force feedback settings for realistic feel
• Test input mapping before running DIL sessions

Haptic Feedback

Haptic feedback devices like Buttkicker and pedal haptics significantly enhance immersion and provide tactile feedback from the simulation.

SimHub Integration: SimHub is the recommended tool for setting up haptic feedback with BeamNG.tech. It provides:

• Easy configuration for Buttkicker and other haptic devices
• Support for pedal haptics
• Real-time data extraction from the simulation
• Quick setup (typically done in minutes)

Setup Process:

1. Install SimHub
2. Configure your haptic devices in SimHub
3. Connect SimHub to BeamNG.tech data output
4. Calibrate intensity and response settings

For detailed SimHub tutorials, refer to the SimHub documentation or community guides.

Audio Setup

Soundbar Integration: A soundbar can be integrated into the sim rig setup to provide spatial audio feedback. This enhances the immersive experience by delivering directional sound cues that correspond to in-simulation events.

Configuration Tips:

• Position the soundbar to provide optimal audio coverage
• Calibrate audio settings to match the simulation environment
• Test audio synchronization with visual feedback

VR Headset Considerations

Virtual Reality headsets can be used as an alternative to multi-monitor setups for DIL testing, providing a fully immersive 360-degree view.

VR Headset Options:

• Quest 3: Reliable option with good compatibility and stability
• Varjo XR-4: High-end option with superior visual fidelity, but may have driver stability issues and tracking problems in some configurations

Important Considerations:

• VR headsets may have compatibility issues with multi-monitor configurations
• Some VR headsets may require specific motherboard configurations
• Driver stability can vary significantly between models
• Consider backup options for critical demonstrations or testing sessions
• VR facial interfaces or covers may be needed for hygiene in shared setups

Recommendation: For production or demonstration environments, consider using established, stable VR solutions rather than early-access or experimental hardware.

Motion Platform (Advanced)

Motion platforms can provide physical motion feedback synchronized with the simulation, significantly enhancing realism. However, motion platform integration requires:

• Specialized hardware and software
• Significant setup and calibration time
• Additional safety considerations
• Higher complexity in system integration

Motion platforms are typically considered for advanced setups and may require external expertise for proper implementation.

Common Issues and Troubleshooting

Triple Monitor Issues

Problem: Different screen dimensions causing rendering issues

• Solution: Use monitors of the same model and resolution when possible. For mixed setups, refer to the forum discussion for specific workarounds.

Problem: Graphics connector issues (e.g., burned connectors)

• Solution: Ensure proper power delivery and use quality cables. Monitor GPU temperatures during extended sessions.

Hardware Configuration Issues

Problem: Hardware not recognized or not working properly

• Solution:
  • Verify drivers are up to date
  • Check manufacturer software configuration
  • Test hardware in other applications first
  • Review input device settings in BeamNG.tech options

Problem: Input lag or delayed response

• Solution:
  • Check USB connection quality (use USB 3.0 ports when available)
  • Reduce system load (close unnecessary applications)
  • Adjust input sensitivity settings
  • Verify frame rate is stable

Performance Issues

Problem: Low frame rates with multi-monitor setup

• Solution:
  • Reduce graphics quality settings
  • Ensure adequate GPU power (high-end GPU recommended)
  • Monitor GPU and CPU temperatures
  • Consider reducing view distance or particle effects

Integration with BeamNG.tech

BeamNG.tech provides the simulation backbone for DIL setups, offering:

• Realistic vehicle dynamics and physics
• Comprehensive sensor suite for ADAS development
• Scenario-based testing framework
• Support for various hardware interfaces
• Multi-monitor rendering capabilities
• Real-time data output for haptic feedback systems

For more information on ADAS features available in BeamNG.tech, see the ADAS Features section .

For general multi-monitor setup information, see the Multi-Monitor Render tutorial .

Combining HIL and DIL

HIL and DIL setups can be combined to create comprehensive testing environments that integrate both hardware components and human drivers. This hybrid approach enables:

• Real-time hardware validation with human-in-the-loop testing
• CAN-Bus connected dashboards displaying simulation data to drivers
• Hardware tableau displays showing CAN-Bus signals during DIL sessions
• Simultaneous evaluation of hardware performance and driver interactions

Example Setup: A typical combined setup might include:

• Triple monitor configuration (with optional 3D center screen) for the driver
• CAN-Bus connected hardware (dashboards, displays, ECUs)
• Sim rig with steering wheel, pedals, and haptic feedback
• External displays showing CAN-Bus signals and system status
• Audio system (soundbar) for spatial feedback

This combination allows for comprehensive testing scenarios where hardware behavior and human responses can be evaluated simultaneously.