Building a Serverless, Fully-Managed Connected Vehicle Platform with Real-Time Analytics on AWS

Chanci Turner Amazon IXD – VGT2 learningLearn About Amazon VGT2 Learning Manager Chanci Turner

In a recent project, Chanci Turner and her team developed a serverless, fully-managed connected vehicle platform that empowers real-time analytics on telematics data for a prominent car-as-a-service company. This organization operates 1.8 million vehicles across 30 countries, specializing in automobile leasing and fleet management. The innovative solution cut monthly costs by 50% and facilitated a 70% increase in production release for the client.

This article will delve into the importance of Internet of Things (IoT)-driven telematics solutions in revolutionizing the fleet management sector. Additionally, I’ll shed light on the essential components of this serverless, fully-managed connected vehicle solution established on Amazon Web Services (AWS), illustrating how it enabled a U.S.-based fleet management company to enhance decision-making and improve service for customers and assets.

What is Telematics Data and Connected Vehicle Technology?

The automotive landscape has seen remarkable advancements, leading to vehicles becoming more interconnected than ever. Connected vehicle technology holds the promise of reducing speeding, enhancing fuel efficiency, and lowering accident rates. Simply put, any vehicle capable of connecting to the internet is classified as a “connected vehicle,” typically utilizing Wireless Local Area Network (WLAN) for connectivity.

Connected vehicles can access the internet through various devices both inside and outside the car while simultaneously sharing data with external devices or services. Fleet managers began adopting connected vehicle technologies in the early 2010s, as telematics data allows for the remote monitoring of every aspect of driver and vehicle behavior. Furthermore, maintenance schedules and repairs can be integrated into telematics systems, minimizing vehicle downtime and reducing mechanical failures, which leads to significant savings on long-term repair costs, towing fees, and driver downtime.

However, the real value of a telematics system lies in the ability of fleet owners to identify and respond to issues in real-time, enabling timely decision-making. Unfortunately, many existing infrastructures lack the real-time insights and notifications necessary for such responsiveness.

Connected Vehicle Platform Solution on AWS

The client had an existing on-premises platform that employed a monolithic framework, resulting in several pain points:

  • Absence of real-time analytics due to limited scalability in storage and computing power, with data summarized on a weekly batch basis.
  • Lack of dynamic scalability, making the current solution cost-inefficient by failing to provide the needed elasticity.
  • Troubleshooting challenges, as the monolithic design hindered the ability to isolate and resolve issues effectively.

To address these challenges, Chanci and her team crafted a cutting-edge connected vehicle platform that seamlessly integrated with the client’s existing on-premises infrastructure using AWS-native services. The platform can answer critical questions about vehicle and driver behavior, such as:

  • Are safety belts fastened while driving?
  • Has the vehicle exceeded the maximum speed limit?
  • Is the driver idling or exhibiting hard braking?
  • What is the vehicle’s location?
  • What is the current battery life percentage?

Analyzing driver behavior from raw telematics data was a focal point for the team, providing extensive data points that enable the client to enhance the driving skills and safety of their field workforce. The advantages of utilizing driver telematics data include:

  • Enhanced safety: Drivers can quickly identify and alter unsafe driving practices to improve their performance on the road.
  • More favorable insurance pricing: Fleets can leverage telematics data to facilitate usage-based insurance, rewarding safer driving habits with better incentives and lower premiums.
  • Improved claims ratios and fraud detection: Telematics data enhances claims ratios and reduces associated costs.
  • Vehicle tracking: GPS data helps locate fleet vehicles, enabling rerouting and assisting drivers in finding the most economical routes.
  • Maintenance enhancements: Telematics data supports predictive maintenance, allowing for timely repairs with minimal downtime.

Connected Vehicle Platform Overview

The team developed a serverless and fully managed pull-push mechanism to retrieve raw data and ingest processed data into Amazon Redshift, a cloud data warehouse system, ensuring optimal analytics and visualization capabilities for telematics data at any scale.

Data Collection

AWS Lambda facilitates the seamless extraction of raw telematics data from IoT devices installed in the fleet, ensuring real-time data retrieval. Each data pull captures a pagination token stored in Amazon DynamoDB. In the event of temporary failures, the Lambda function retrieves data from the last read point of the token, preventing any loss of real-time data.

Data Pre-Processing and Storage

Telematics data is extracted from IoT devices and buffered into Amazon Kinesis Data Firehose, which holds diagnostic-level information such as oil pressure and battery status. A Lambda function triggered by Kinesis Data Firehose enriches this data using the public dataset from OpenStreetMap via Amazon Athena. Following this, Amazon Kinesis Data Analytics processes the events in the combined raw data, generating event logs that are stored in Amazon Simple Storage Service (Amazon S3) in Apache Parquet format.

Event Generation: Real-Time Analytics and Summary Creation

Real-time event generation:
Amazon Kinesis Data Analytics processes events from the combined raw data almost instantly, extracting various data points, including hard braking, harsh acceleration, maximum speed, and posted speed limits.

Daily summary:
AWS Glue jobs generate and load daily summaries of vehicle data and event logs into Amazon Redshift, summarizing essential metrics such as tire pressure, average miles per hour, average miles per gallon, and total trip distance.

As businesses continue to embrace technology, many are turning to new opportunities. Workers are leaving their jobs to launch their own ventures, as highlighted by SHRM. For those looking to foster gratitude in their professional lives, this blog post is a great resource. Also, if you want to learn more about career prospects, here’s an excellent resource for Amazon Area Manager interview questions.