Prof. Dr.-Ing. habil. Björn Hein

Vita

Academic and Professional Career
Since 2023 – Founding member and spokesperson of the Institute of Robotics and Autonomous Systems (IRAS), Karlsruhe University of Applied Sciences (HKA); joint institute leadership with Prof. Dr.-Ing. Christian Wurll
Since October 2018 – Research Professorship (W3) Intelligent Production, Karlsruhe University of Applied Sciences, focus on cloud robotics
Oct. 2016 – Apr. 2017 – Acting Professor (W3) and interim head of the Institute for Process Control and Robotics (IPR), Karlsruhe Institute of Technology (KIT)
May 2012 – Sep. 2018 – Shared Professorship (W2) Interaction Technologies for Robot Systems, IPR, KIT, in cooperation with SCHUNK GmbH & Co. KG (evaluated “very good” in 2015)
2002 – 2012 – Group leader, IPR, University of Karlsruhe (TH) / KIT; took over the research group “PaRo – Parallel Robots” and founded the research group “IIROB – Intelligent Industrial Robots” (up to nine researchers)
2010 – Habilitation “Model-based Online Programming for Industrial Robots”, KIT
2003 – Doctorate “Automatic Offline Programming of Industrial Robots in the Virtual World”, University of Karlsruhe (TH)
1998 – 2002 – Doctoral scholarship, Research Training Group “Controllability of Complex Systems”, IPR, University of Karlsruhe (TH)
1998 – Diploma in Electrical Engineering, University of Karlsruhe (TH), specialisation in control engineering and robotics

Industry and Technology Transfer
Since 2006 – Shareholder of GFRT – Fortschrittliche Robotertechnologie GmbH & Co. KG, Karlsruhe (IPR spin-off: calibration methods and systems, collision detection, path planning)
2012 – 2018 – Support of pre-development at SCHUNK Mobile Greifsysteme GmbH, Lauffen, as part of the shared professorship

Patents
Granted: Intuitive view-based Cartesian robot control using a virtual third-person camera (filed 2012; S. Notheis, M. Mende, B. Hein)
Granted: Sensor module, sensor system and method for capacitive, spatially resolved detection of approach and contact (filed 2015; S. Escaida, H. Alagi, M. Mende, B. Hein)
Pending: Sorting system and method for sorting material, WO 2025/172286 A1 (Fraunhofer, HKA, GFRT)

Research Awards
2025 – Research Award of Karlsruhe University of Applied Sciences for the cooperative doctoral programme KATE “Accessibility through AI-based Assistive Technologies”, together with M. Wölfel, S. Kinkel, A. Laubenheimer and C. Wurll
2023 – Best Paper Runner-up, IAS-18, Suwon, Korea: “Gradient based Grasp Pose Optimization on a NeRF that Approximates Grasp Success” (G. Sóti, B. Hein, C. Wurll)
2019 – NEO 2019 Innovation Prize “Artificial Intelligence for Working Environments” (HoloMed project: AI and AR to support surgeons in the operating room)
2015 – Application Innovation Award “Design of EXO-LEGS Exoskeletons”, CLAWAR 2015, Hangzhou
2013 – Finalist, JTCF Novel Technology Paper Award, IROS 2013, Tokyo: “Methods for Safe Human-Robot-Interaction Using Capacitive Tactile Proximity Sensors”
2011 – Best Paper, Future Computing 2011, Rome: “Evaluation of Seed Throwing Optimization Meta Heuristic in Terms of Performance and Parallelizability”

Teaching Awards
2023 and 2024 – HECTOR Teaching Award, 1st place, master’s lecture on industrial robot programming
2017 and 2014 – Best elective lecture of the KIT Department of Informatics, “Innovative Concepts for Programming Industrial Robots”

Industry and Technology Transfer Awards
2015 – Finalist, Invention and Entrepreneurship Award in Robotics and Automation (IEEE/IFR), Seattle: collision-free online path planning and scheduling for multiple industrial robots (partners: GFRT, Daimler)
2010 – Walter Reis Innovation Award for Robotics, 2nd place, Munich: first production use of automatic collision-free online path planning (partners: IPR, GFRT, Daimler)
2006 – Winner, Invention and Entrepreneurship Award in Robotics and Automation (IEEE/IFR), Beijing: online collision avoidance based on complex geometries and kinematic models (partners: IPR, GFRT, KUKA)

Offices and Committees
Since 08/2026 – Chair of IFAC Technical Committee TC 4.3 Robotics for the 2026–2029 triennium (previously Vice-Chair 2017–2023, Deputy-Chair 2023–2026)
2026 – Guest Editor of the Journal Option of the IFAC World Congress 2026, Busan
2020, 2023, 2026 – Associate Editor, IFAC World Congress
Since 12/2024 – Founding member of the executive board of ROBDEKON e.V.
2019 - 2024 – Advisory Board, Fraunhofer lighthouse project SWAP
Since 2006 – Member of the AutomationML consortium (robotics working group until 2016); contributed to the kinematics definition of the COLLADA 1.5 standard
2022, 2023 – Program Committee, ISR Europe, Munich
2022 – Workshops Chair, IAS-17, Zagreb; Program Committee, IMS 2022 (IFAC)
2021 – Workshops Co-Chair, IROS 2021, Prague; Program Committee, ECMR 2021
2018 – 2022 – (Co-)organizer of the IROS workshop series “Proximity Perception in Robotics”
2018, 2021 – KUKA Round Table R&D
2017 – 2019 – Deputy spokesperson for robotics, Franco-German Institute “Industry of the Future” (ENSAM/KIT)
2014 – 2018 – Program Committee, SCHUNK ExpertDays

Reviewing
Since 2026 – Reviewer for AiF Projekt GmbH, Bavarian funding programme for applied research
Since 2017 – Regular reviewer for the German Research Foundation (DFG)
2010, 2013 – Reviewer for programmes of the German Federal Ministry for Economic Affairs (“Autonomik”, “Industrie 4.0”)

Memberships
IFAC – International Federation of Automatic Control
IEEE – Institute of Electrical and Electronics Engineers, Robotics and Automation Society (RAS)

Teaching

Courses at Karlsruhe University of Applied Sciences (HKA)

Master
Robot Programming
Cyber-Physical Production Systems

Bachelor
Robotics – Theory and Practice
Industrial Robot Programming

Further courses at Karlsruhe Institute of Technology (KIT)
Innovative Concepts for Programming Industrial Robots (Master)
Autonomous Robotics Lab, HECTOR School of Engineering and Management (Master, block course)

Research

Research projects at HKA

May 2025 to Oct. 2025: TetriSort, Robot-based Tetris-like sorting of recyclables, invest-bw, Baden-Württemberg Ministry of Economic Affairs, Labour and Tourism
Content: The feasibility study aims to show that combining novel robotic handling methods with AI-based object recognition and characterisation enables automated, profitable sorting of residual streams and high recycling rates for lightweight packaging. Manual sorting by humans in this hazardous environment could thus be eliminated.
Research focus: Robotic handling methods combined with AI-based object recognition and characterisation for automated sorting of lightweight packaging in recycling.
Partners: IOSB

Jan. 2025 to Jun. 2029: DeepFrame, Dataset Engineering and Evaluation Procedures For Reconstructive neural Architectures with Modal Expandability, BMBF
Content: Robust and reliable artificial intelligence for industry. In an increasingly digital world, AI methods are becoming ever more important in industrial processes. DeepFrame aims to improve the robustness, quality and reliability of AI systems, especially in challenging and unexpected situations.
Research focus: Data focus: development of an interpretable evaluation system for assessing the robustness of AI-based sensor systems. Architecture focus: development of new model architectures for fusing and reconstructing sensor data, and of specific training processes for multimodal models with masked input data.
Partners: VisionTools, Elma Electronic, DE software&control

Dec. 2022 to Nov. 2026: ROBDEKON II, Robotic systems for decontamination in hazardous environments, BMBF
Content: The competence center “Robotic Systems for Decontamination in Hazardous Environments” is dedicated to researching autonomous and semi-autonomous robotic systems for use where work has so far posed considerable risks to humans. At HKA, robotic systems and methods for the autonomous exploration of building structures and the cleaning of contaminated plant components are investigated.
Research focus: Semantic modelling, semantic exploration, AR-based interaction and configuration, multi-robot setups.
Partners: IOSB, DFKI, KIT, FZI, Götting, KAH, ICP

Oct. 2022 to Mar. 2027: KATE, Doctoral programme “Accessibility through AI-based Assistive Technologies”, Baden-Württemberg Ministry of Science (MWK)
Content: The programme aims to improve the autonomy and participation of people with disabilities through assistive systems based on artificial intelligence.
Research focus: Interactive training and assistance systems for fall prevention and for training motor and cognitive skills of people with cognitive or physical impairments.
Partners: KIT

Jan. 2021 to Jun. 2025: KI5GRob, Cloud computing and 5G as enablers of new sensor technologies in robot-based production and logistics, BMBF
Content: Intelligent, autonomous robot-based production and logistics systems will play a central role in Germany’s competitiveness. Fusing cloud technologies and AI with robotics in production and logistics is considered one of the key concepts for realising such systems. Advanced cloud concepts combined with 5G allow cloud services and on-site robotic systems to be tightly interlinked in real time.
Research focus: AI methods, software and hardware architecture and communication infrastructure in cloud robotics (e.g. control as a service), usability.
Partners: KUKA Deutschland AG, AAT Automation GmbH, Roboception GmbH, Schmalz GmbH

Jan. 2021 to Dec. 2021: SyDaVis-AI, Synthetic Data for Vision Systems with AI, Baden-Württemberg Ministry of Economic Affairs, Labour and Housing
Content: SyDaVis-AI aims to train AI-based evaluation methods for image processing systems using synthetic image data (transfer learning) long before the start of production, so that they can be used successfully in real applications. The training data are generated in simulation from existing CAD models and textures, giving customers a validated inspection system before production starts. Particular attention is paid to modelling the camera and optics, which have so far only been used in highly simplified form (pinhole camera).
Research focus: Synthetic data generation for image processing.
Partners: VisionTools, Lensation

Sep. 2017 to Dec. 2019: Rob-LPI, CAD-based planning of robot-guided camera systems for large-volume inspection tasks, KMU-innovativ, BMBF
Content: The project designs and develops the first robot-guided Industry 4.0 inspection system: a planning and execution system for the robot-based inspection of large-volume components. Based on CAD data of the cell and the components including their variants, optimal sensor positions, robot positions and an optimal schedule for the given inspection tasks are determined automatically.
Research focus: Image synthesis for realistic simulation of camera-based sensors, and path planning.
Partners: VisionTools GmbH, GFRT GmbH, KIT/IPR

Research projects at KIT

Feb. 2018 to Jan. 2022: ROBDEKON, Robotic systems for decontamination in hazardous environments, BMBF
Content: This subproject of the competence center develops autonomous and semi-autonomous robotic systems for manipulation and inspection in decontamination tasks, including the design and realisation of these systems and their holistic control architecture as well as methods for planning and sensor-based execution of mobile and static multi-arm manipulation tasks.
Research focus: Control architectures for autonomous and semi-autonomous robotic systems; planning and sensor-based execution of mobile and static multi-arm manipulation tasks.

Feb. 2016 to Dec. 2020: SafeLog (coordinator: Björn Hein), Safe human-robot interaction in logistic applications for highly flexible warehouses, EU Horizon 2020
Content: New safety concepts and human-machine interaction in modern robot-based distribution centres. Challenges include safe overlapping workspaces for humans and robots, planning orders for the heterogeneous human-robot system, and supporting humans with new visualisation and interaction concepts based on augmented reality.
Research focus: Human-machine interaction, augmented reality, image processing.
Partners: KIT/IPR, Swisslog, Czech Technical University in Prague, University of Zagreb, Fraunhofer IML, KONCAR

Aug. 2017 to Jul. 2020: RoSyLernt, Learning robot-assisted systems for neuromuscular training, BMBF
Content: Development of a learning physical interaction capability as an active skill of a robotic system. The coordinated application scenarios come from rehabilitation (muscle building and muscle coordination) and are intended to provide deep insight into the kinematic and dynamic dependencies of human interaction with the robotic system.
Research focus: Learning methods for physical human-robot interaction.
Partners: Buck Engineering, KUKA, Koordinauten GmbH, RWTH Aachen (IRT), KIT/IPR, KIT/ZAR

Jul. 2017 to Jun. 2020: SINA (coordinator: Björn Hein), Safe perception for flexible assistance in dynamic and unstructured environments, BMBF
Content: The goal is transferable interactive basic skills that, among other things, allow objects to be handed over safely and robustly between humans and robots. The project extends human-robot interaction with novel capacitive sensors as the basis for robust and safe skills at practical execution speeds. The robot’s behaviour minimises physical and mental strain on the human during interaction.
Research focus: Safe and intuitive handover of objects between humans and robots.
Partners: C&S Computer und Software GmbH, KIT/IFAB, KIT/IPR, MRK-Systeme GmbH, SCHUNK GmbH & Co. KG, University of Augsburg (ISSE), User Interface Design GmbH

Feb. 2017 to Jun. 2020: QBIIK, A learning, mobile, autonomous logistics platform with tactile gripping system and novel decoupled human-machine interface, BMWi
Content: Development of a learning autonomous order-picking forklift that combines autonomous-system technology with human capabilities. The decentrally controlled vehicle localises itself, navigates autonomously to its destination and picks the required goods on its own, supported by a human where necessary.
Research focus: Grasping with proximity sensors, safe human-machine interaction.
Partners: KIT/IPR, KIT/IFL, BÄR Automation GmbH, STILL GmbH, Audi Sport GmbH

Sep. 2014 to Apr. 2018: Tactile Proximity Sensors (TNS), Methods for exploration, manipulation and safe human-robot interaction with capacitive tactile proximity sensors, DFG
Content: In robotic manipulation, continuous sensing of the objects being handled is advantageous. Tactile sensors only detect objects or obstacles once contact has occurred, while occlusion close to an object often makes camera-based systems difficult to use. Spatially resolving proximity sensors can close this perception gap. The project therefore explores and evaluates new applications of tactile proximity sensors in human-machine interaction and in industrial contexts.
Research focus: Tactile proximity sensors in human-machine interaction and in robot control (proximity servoing).
Partners: KIT/IPR

Publications

see ResearchGate

Interests

• Cloud/edge robotics and robotics software infrastructure (KubeROS, ROS 2, RobOps)
• Synthetic data, transfer learning and robust AI-based computer vision
• Grasping and manipulation with learned representations (NeRF, reinforcement learning)
• Tactile proximity sensing and safe human-robot interaction
• Motion planning, control and multi-robot systems
• Assistive robotics and human-robot interaction