Tech Library
[ ]
Solution Guide

Sensors solutions that enable advanced control of service robots

  • PDF
  •                
Service robots are widely used in various situations such as logistics / transport, security, cleaning, housework, hobbies / entertainment and care / assistance. Since service robots are used in a wide variety of situations, it is necessary to fulfil many requirements such as smooth communication with humans (HMI), ensuring safety and responding to changes in the real time. In service robots, the role of a sensor is very important. In this article, we will take a vacuum cleaner robots as an example.

TDK products for "Vacuum cleaner robot"

The vacuum cleaner robot uses a huge variety of sensors. "Motion Sensor" to detect the position, "Microphone" for voice recognition, "Barometric Pressure Sensor" to detect when the dust bin is full, "Ultrasonic ToF Sensor" to detect obstacles, "Gas and Temperature Sensor" to detect the indoor environment, "Current Sensor" for managing the battery , "Hall and TMR Sensor" for detecting the angle and position, etc. In addition, "Embedded Motor Controller" is designed for the drive of small brush-type, stepper, or brushless motors and can use the integrated MCU as a secondary micro-controller inside the end application. TDK also offers additional Sensor Solutions to support specific application requirements.

Figure 1 : Diagram block - Vacuum cleaner

Floor type, cliff and obstacle detection

The Floor type, Cliff and Obstacle detection applications are developed to demonstrate and use the capabilities of TDK's Ultrasonic Time-of-Flight range sensors, CH101 and CH201.

The CH101 and CH201 are miniaturized, ultra-low power Ultrasonic Time-of-Flight (ToF) range sensors. the CH101 and CH201 provide accurate range measurements to targets at distances up to 1.2m and 5m respectively. Using ultrasonic pulse-echo measurements, the sensors work in any lighting conditions, including full sunlight, and provides millimeter-accurate range measurements independent of the target’s color and optical transparency. The sensors wide Field-of-View (FoV) enables simultaneous range measurements to multiple objects in the FoV.

Floor type detection application demonstrates floor surface type sensing by using the signal measurements from CH101 modules. The application uses the average amplitude of a reflected ultrasonic signal to determine if the target surface is "hard or "soft".

Presence-Detection application demonstrates the use of motion detection to determine the presence of people and objects.The Presence-Detection application can observe and run with either a single sensor.

Cliff Detection application indicates cliff sensing by using CH101 module, it can configure and operate one or more CH101 sensors.

The above applications can be used in various robotic products like drones, vacuum cleaners, autonomus mobile robots (AMR), humanoids or collaborative robots.

Figure 2 : Floor type, cliff and obstacle detection

Ultrasonic sensing basics

Floor Detection Obstacle Detection Drop/Cliff Detection

RoboVac (Software solution)

The RoboVac software was developed specifically for our premium 6-axis motion sensor ICM-42688-P in vacuum cleaner robot application. It is an enablement software to leverage the performance of the ICM-42688-P while compensating for the known weaknesses found in MEMS motion sensors.
Some key features enabled by TDK's RoboVac Software include:

・ Leverage ICM-42688-P high resolution (20-bit), precise sampling (RTC) and stability (VLN) and fuse the 6-axis data to provide a precise and stable heading for robot path planning.
・ Calibrate sensor bias initially after the robot turned on and before ready to go.
・ Estimate fusion degradation over time and temperature and indicate the host to stop for dynamic calibration.
・ Dynamically calibrate sensor bias drift over time and temperature time to time.

Figure 3 : ICM-42688-P

ICM-42688-P (High Performance 6-Axis IMU perfect for Robotic Motion Tracking Applications)

  • ・ 6-axis MEMS motion sensor
  • ・ Industry leading performance unlike any other Noise, sensitivity, bias stability over time & temperature
  • ・ Unique features to further improve application performance Sample synch with RTC, 20-bit ADC, up to 32kHz ODR
  • ・ Low power consumption
    A+G in low noise mode: 880µA
    A in low power mode: <50µA
  • ・ Small package
    2.5 x 3.0 x 0.91mm LGA-14
Key parameters ICM-42688-P Comment
Gyroscope Sensitivity Error (%) ±0.5 The most critical parameter for gyroscope
Sensitivity Temperature Coefficient (%/°C) ±0.005 Critical parameter for application with very dynamic temperature range
Zero Rate Offset (dps) ±0.5
(board level)
The smaller the easier for initial calibration and even get ride of it
Zero Rate Offset Temperature Coefficient (dps/°C) ±0.005 The smaller the less influence by temperature variance
Noise Density (dps/√Hz) 0.0028 The key parameter for robotics application
Accelerometer Sensitivity Error (%) ±0.5
Sensitivity Temperature Coefficient (%/°C) ±0.007
Zero-G Offset (mg) ±40
(board level)
The smaller the easier for initial calibration and even get ride of it
Zero-G Offset Temperature Coefficient (mg/°C) ±0.15 The smaller the less influence by temperature variance
Noise Density (µg/√Hz) 75 The key parameter for robotics application
Figure 4 : Sensor fusion & in-use calibration software does matter for robot heading tracking
  • Regular 6-axis sensor fusion & calibration

VS

  • TDK RoboVac (Software solution)
  • ・Best-in-class fusion
  • ・Smart in-use calibration
  • ・Through technical support
    for integration and fine-tuning
Figure 5 : RoboVac Algorithm description
  • ・IMU accelerometer, gyroscope and temperature measurements (from ICM-42688-P) are fed to RoboVac
  • ・RoboVac algorithm:
    Evaluates the quaternion for the host application to control the robot movement
    Calibrates for sensors errors (bias drift) in order to maintain accurate heading estimation
    Commands the robot to stop if new calibration is required
    Processing data rate: 1000Hz, 200Hz, 100Hz
  • ・Host provides the robot state as input to RoboVac for potential calibration
  • ・Specs: ≤ 10 deg/hour
  • ・Execution overview
    Initial calibration runs only once
    Pause every 5~10 minutes
    1~2 seconds calibration duration
    Motion rejection during calibration

"Dust box full" detection

The level of dust inside the dust bin is estimated by monitoring the flow of air through the dust bin with a pressure sensor ICP-10101. Compared to the air pressure inside the dust bin when the dust bin is empty, the air pressure inside the dust bin begins to drop when the air flow becomes to stagnate due to an increase in suction dust or clogging of the filter.
In order to remove local environmental impacts such as HVAC and detect it more accurately, it is recommended to detect it as a differential pressure that using a similar pressure sensor to measure the outside air pressure.

Figure 6 : Dust box full detection

・Use a pressure sensor to monitor air flow through the dust bin

・Identify full dust bin or clogged filter

・2nd pressure sensor can optionally be used to improve the solution by removing the local environmental effects such as HVAC.

Figure 7 : Evaluation results ICP-10101

Embedded Motor Controllers

The HVC flex servo-drive family from TDK enables cost-effective realization of high-performance compact electric motor control. The new HVC 4422F offers extended memory size to address the OEM diagnostic requirements and allows operation in high-temperature environments. An integrated MPU supports RTOS requirements. Powered by a 32-bit CPU core (Arm Cortex-M3), the HVC controllers economically address growing challenges in the robot market and beyond (industrial, consumer, instrumentation, etc.). The flexible peripherals of the product provide all means to directly control brush-type, stepper (bipolar or three phase), or brushless (BLDC) motors directly.

The HVC family further features a flash program memory with a size of 32 kbytes (HVC 4222/4223) or 64 kbytes (HVC 4420F/4422), providing high flexibility in code development, production ramp-up, and in-system firmware update.

Figure 8 : HVC Features

Fully integrated single-chip motor-control solution MCU+Drivers for small motors

  • ・ Flexibility for sensored or sensor-less stepper, brushed and brushless DC-motor control.
  • ・ High-performance to enable sophisticated control schemes.
  • ・ Minimal number of external components.
  • ・ Supporting system diagnosis routines.
  • ・ Short development time
    ¬Easy-to-use development tools and app notes
    ¬Complete working demos
    ¬Professional automotive certified firmware package
    ¬Easy configuration and re-use between different applications
Figure 9 : Block diagram - System Architecture
Product Package Ordering Code Interface Temp. Range: Note
HVC 4222F QFN40 HVC4222F-DL LIN, UART, SPI -40°C - 160°C 32k Flash, 2k RAM,
TA = 150 °C
HVC 4223F QFN40 HVC4223F-DL LIN, UART, SPI -40°C - 150°C 32k Flash, 2k RAM,
TA = 125 °C
HVC 4420F QFN40 HVC4420F-DL LIN, UART, SPI -40°C - 150°C 64k Flash, 4k RAM
integrated MPU
TA = 125 °C
HVC 4422F QFN40 HVC4422F-DL LIN, UART, SPI -40°C - 160°C 64k Flash, 4k RAM
integrated MPU
TA = 150 °C

Temperature sensors for robotics

In robotics, TDK's sensors are used for monitoring temperature, which is essential for controlling various functions.
TDK supports high-precision temperature detection with a wide products portfolio.

NTC element with lead
NTC elements are available in the high reliable glass encapsulation, which are the radial lead type with short response time and the easy-to-handle rigid axial lead type. For options, coating of NTC head and leads for high insulation and moisture resistance and lead wire processing that contributes to the simplification of the mounting process are also available.

Bondable NTC chip
The bondable NTC chip is intended to be used in semiconductor devices in which wire bonding is used in charging battery stationary and motor controller for robotics products. Those sensors are directly mounted in intelligent power modules and monitor the power semiconductors junction temperature.

Figure 10 : Product onerview of NTC thermistors
Glass-encapsulated Resin coated Bondable
Type Radial lead Axial lead Mini sensor New Mini sensor Chip
Picture
Type
(Part No.)
G15*0/G15*1
(B575*0G1*/B575*1G1*)
NTCDS/NTCDA
/NTCDE/NTCDZ
S864
(B57864S*)
L862
(Under Development)
S860
(B57860S*)
Feature
  • Very short response time
  • Small dimensions
  • Hardness lead for easy handling
  • Improved resistance to humidity
  • Short response time
  • Lead-free
  • Tight temperature tolerances
  • Extremely high long term stability
  • High thermal shock resistance
  • Lead-free
  • UL approval (E69802)
  • Top and bottom surface metallized (gold or silver)
  • High temperature rating available
Temperature range -40 °C to 300 °C -40 °C to 250 °C -55 °C to 155 °C -55 °C to 155 °C -40 °C to 150 °C
Lead wire
  • Dumet wires (copper clad FeNi)
  • Optional coating of glass body and leads for electrical insulation (G15*1), up to 260°C.
  • Optional with lead-spacing
  • Nickel plated CP wire, available Sn plating.
  • Optional lead bending(NTCDA, NTCDE)
  • Optional coating for insulation or reducing stress (NTCDZ), up to 160°C.
  • Insulated silver plated nickel wire, AWG30.
  • Insulated silver plated nickel wire
  • Leadless
  • Bondable NTC chip
Package Bulk, Stripe Bulk
Ammo packing
Bulk Bulk, Stripe On tape
(on 8-inch frame)

Multilayer chip NTC
SMD chip NTC is ideal for on-board temperature detection and temperature compensation with dimensions series from 3216 to 0402. Also available for conductive adhesives.
>>Link to Selection Guide of Chip NTC Thermistors

Temperature sensor assembly / systems
To monitoring the temperature via heatsink of such as IGBT, capacitors, coils in robotics either directly or indirectly, screw-in or screw-on sensors are well-established solutions as they can be easily mounted to the dedicated components. And the air temperature sensors have good possibilities to detect the cooling air temperature and steer the cooling fan.
Please contact us to arrange NTC characteristics, lead length / terminal processing, etc. in addition to standard part numbers.

 Figure 11 : Product onerview of NTC Sensor Assembly / Systems
Screw-in Sensor Screw-on Sensor Air Temperature Sensor Case type Sensor
Type K45 M703/M1703 NTCGP(Lug terminal) M500 NTCGP(Resin potting) NTCRP
Picture
Feature
  • NTC thermistor potted into a screw-in aluminum case
  • Insulation voltage Vins >2500Vac/1s
  • Good thermal coupling through screw-in case (M3 thread)
  • Tinned copper leads
  • RoHS compatible
  • NTC thermistor encapsulated in metal tag case with cable outlet
  • Insulation voltage Vins > 2700 Vac/1s (higher on request)
  • Good thermal coupling through metal tag
  • Fast and simple screw-on installation
  • RoHS compatible
  • NTC thermistor encapsulated by epoxy is attached metal lug terminal
  • Possible to affix using a fasten screw and to perform stable temperature detection of the mounting surface.
  • Response time in still oil is 6sec max.
  • Pb free
  • RoHS compatible
  • Thermistor with epoxy encapsulation and PVC insulated wires
  • Response time in air stream is approx. 20sec
  • Insulation voltage Vins > 1250 Vac/1s
  • RoHS compatible
  • NTC thermistor encapsulated by epoxy
  • Tinned parallel PVC insulated wire
  • Response time in still oil is 6sec max.
  • Pb free
  • RoHS compatible
  • NTC thermistor encapsulated by glass is potted in small resin case
  • Excellent high reliability in harsh environment
  • High operation temperature up to 200℃
  • Pb free
  • RoHS compatible
Temperature range -10 °C to +125 °C M703: -20°C to 125°C
M1703: -10°C to 260°C
(sensor head)
-40 °C to +125 °C -30 °C to +100 °C -55 °C to +105 °C -40 °C to +200 °C
Standard dimensions

RoboKit

The TDK RoboKit is a new development kit that enables seamless integration of solutions from TDK’s portfolio specially designed for the robotics market. RoboKit integrates key TDK offerings such as ICM-42688-P 6-axis Inertial Measuring Unit (IMU), ICP-10111 capacitive barometric pressure sensor, ICS-43434 multimode digital microphone, CH101 and CH201 ultrasonic Time of Flight (ToF) sensors, and Micronas motor controller, angle sensor, and pressure sensors. TDK delivers solutions that meet the rigorous demands of the robotics market, such as heading accuracy of under 10 degrees per hour using InvenSense IMUs and RoboVac software, market-ready inertial navigation system (INS) from Coursa Drive, robust obstacle detection for any color objects in all lighting conditions using InvenSense ultrasonic ToF sensor, in addition to robot joint control using Micronas motor controllers. Also included are a temperature sensor and a magnetometer. The TDK RoboKit software also integrates with the leading operating system, ROS. ROS-ready drivers for IMU and ultrasonic range sensor are available now.

>>Link to InvenSense (RoboKit)