Presentation at University of Agder, Norway

GPU Voxels at a Cleanroom 3D Replanning scenario Replanning Online grasp planning based on pointclouds of in-hand-camera 3D View of Lab Environment 3D Replanning scenario

Presentation at University of Agder, Norway

Hello GPU-Voxels users,

I got the kind invitation by Professor Geir Hovland of the University of Agder in Norway to talk about the library and its usage:
https://sfi.mechatronics.no/?p=1447

I am curious to see the research at the SFI Offshore Mechatronics lab and to meet some new users!

So if you happen to be in Agder on March 13th, 2018, I am sure you are welcome to join the talk (:

Best,
Andreas

Read more | Comments Off on Presentation at University of Agder, Norway | Feb 16, 2018

V1.1 – New Year Release

gvl_ompl_planning UR10 6DOF arm motion

Dear GPU-Voxels users, the new release is here!

The bugfixes and new features in Version 1.1 are now available. With this release I take over as lead maintainer for the framework, while Andreas will of course continue to use it and to contribute to it.

As always you find the new release at GitHub.

Most of the changes are bugfixes and changes that improve the debugging process. Also, the new CountingVoxelList was added to offer pointcloud density filtering on the GPU.

One major addition by Andreas Hermann is the gvl_ompl_planning example that links in GPU-Voxels and uses an OMPL planner to move a 6DOF arm model through an environment held in GPU-Voxels data structures. Take care of the README file in that examples folder to avoid issues relating to C++11 and PCL versions.

We are still investigating a couple of known issues in relation with Pascal GPUs and will release fixes for them as soon as possible.

 

Happy coding,
Christian

Update 1: Release 1.1.1 fixes a missing icl_core dependency in gvl_ompl_planning/CMakeLists.txt
Update 2: Release 1.1.2 fixes Cuda 9.1 incompatibility issues

 

Changelog for Release 1.1: New Year Release
Known issues:
- Octrees are broken on Pascal GPUs
  - confirmed on Titan Xp and GTX 1080 Ti
- the GLM in Ubuntu 16.04 has to be patched to allow usage of the visualizer.
  - see https://github.com/g-truc/glm/issues/530
  - patch for /usr/include/glm/detail/func_common.inl in packages/gpu_voxels/doc/glm_fix_issu530.patch

API breaking changes:
- GpuVoxels
  - addMap returns null-initialized shared_ptr if map already exists
  - lockSelf, lockBoth & Co removed, replaced by exception-safe lock_guard
  constructs to improve debugging
- TinyXML
  - use system version from APT package libtinyxml-dev

Major changes:
- Changes in CUDA CMake setup
  - uncomment SET(CMAKE_CXX_STANDARD 11) at the top of CMakeLists.txt to activate C++11 mode
  - set -maxrregcount=63 to avoid errors on desktop GPUs with 1024 threads per block
  - always use ICMAKER_CUDA_CPPDEFINES to pass parameters to nvcc
- Added OMPL planning example gvl_ompl_planning  (Thanks to Andreas Hermann)
  - requires C++11
  - incompatible with GPU-Voxels built with PCL 1.7
- Added model "ur10_coarse" voxelized at 9mm
- Added CountingVoxelList to offer pointcloud density filtering  (Thanks to Herbert Pietrzyk)
  - Use remove_underpopulated(minimum_count) to remove outliers
  - Use subtractFromCountingVoxelList to remove the robot and static objects
- Added BitVoxelMap collision with ProbVoxelmap
- ProbVoxelMap
  - insert() parses BitVoxelMeaning to allow freeing single voxels
  - SVCollider checks for noneButEmpty instead of isZero
- Fix CUDA 9 incompatibilities, issue 63
  - version macro
  - cub namespace
  - __ballot vs __ballot_sync

Minor changes:
- DistanceVoxelTest uses double buffering of DistanceVoxelMap to avoid flickering
- ProbVoxelMap: Speed up the clearing of ProbVoxelMap by using memset instead of ctor calls for every voxel
- C++11 fixes
  - icl_core_logging operator<< stringstream bug
  - various fixes collected by dybedal in issue 55
- VoxelList collision
  - added test cases and examples
- fixed memory leaks in TemplateVoxelList
- fixed PCL dependency of examples and helpers, see issue 61
- fix computeLinearLoad returning grid and block size 0
- added many checks after kernel launches to improve error discovery

Other changes:
- Documentation updates
Read more | Comments Off on V1.1 – New Year Release | Feb 5, 2018

Video about online grasp planning

Hey everyone!

There is a new video in the Demos section.

It demonstrates the calculation of finger angles for a multi-fingered hand via GPU-Voxels. The Swept-Volume collision tests allow to evaluate thousands of different grasp approaches per second. This is used by a hybrid Particle-Swarm-Optimization approach to find the best grasp (not shown in the video):

The video is additional material to our last paper “Eye in hand: Towards GPU accelerated online grasp planning based on pointclouds from in-hand sensor” that was presented on HUMANOIDS 2016.

 

Cheers,

Andreas

Read more | Comments Off on Video about online grasp planning | May 9, 2017

The 1.0 Release is there!!

Voxel Victory

Hello GPU-Voxels users!

It is my pleasure to finally announce Version 1.0 of my framework and invite you to download or update it.
As always you find the new release at GitHub.

The most visible new features can be found in the visualizer, which now has an interactive right-click-menu to change settings and a bunch of new info text overlays.
In the background some bugs were fixes and smaller convenience features have been added (see changelog below for details).

 

Happy coding,

Andreas

 

Changelog for Release 1.0: Added mouse GUI for visualizer (GVL4TW edition)
API breaking changes:
- PrimitiveArrays
  - Fixed the interface by adding metric AND Voxel commands. Fixes issue 41.
  - Renamed the enums for the PrimitiveArray types.

Major changes:
- Changes in CUDA CMake setup
- addMap() now returns a GpuVoxelsMapSharedPtr. Fixes issue 43.
  Throws a std::string in case of error (thanks to Herbert Piertrzyk).
- Generalized collide function of VoxelLists to work with VoxelMaps. Fixes issue 33.
- Fixed relative paths in URDF loding. Fixes issue 30.
- Visualizer:
  - Added a Right-Click-Menu in the visualizer (thanks to Herbert Piertrzyk). Fixes issue 35.
  - Added a bunch of info text overlays (thanks to Herbert Piertrzyk). Fixes issue 26.
- Implemented converter to create BitVectorVoxels from DistanceVoxels.
- Added a scaling function for PointClouds.

Minor changes:
- Improved API stability for DistanceMap computation (Thanks to Christian Jülg).
- New boost test cases:
  - Transformation of PointClouds
  - Collide functions for VoxelLists with VoxelMaps
  - Improved tests for DistanceMaps
- New examples:
  - PrimitiveArray interfaces
- Added div operator for Vector3i / float
- Added mul operator for Vector3f * Vector3f
- Added abs operator for Vector3f
- Added setters for rotations and translations for Matrix4f
- Fixed the SharedMemory transactions between Provider and Visualizer
- Right click info for Voxels in visualizer now also works on VoxelLists

Other changes:
- New coarse model of the SCHUNK SVH hand
- Documentation updates
- More CMake output, when libs can not be found
Read more | Comments Off on The 1.0 Release is there!! | Apr 27, 2017

Video featuring Distance Fields

Hey everyone!

I am proud to present a new entry in the Demos section.

We demonstrate the Euclidean Distance Transformation feature of GPU-Voxels which allows you to derive 3D Distance Fields from pointclouds with high performance. In the video a flying drone plans a path through a environment, sensed only with on-board sensors. From the data a distance map is built on the fly with 30 Hz. So for every Voxel a simple wavefront planner can query the closest obstacle (plus its distance) and find a path that keeps a safety margin from the walls and only chooses openings that are large enough for the drone:

Try the feature by yourself! The X-Mas Release of GPU-Voxels comes with a “distance-kinect” example.
Thanks to Christian Jülg for re-implementing the “Parallel Banding Algorithm” that derives the Distance Maps! Here is a link to Cao Thanh Tung‘s original work: http://www.comp.nus.edu.sg/~tants/pba.html

 

Cheers,

Andreas

Read more | Comments Off on Video featuring Distance Fields | Jan 19, 2017

X-Mas Release (v0.93) – Distance Fields

GPU Voxels X-Mas Edition

GPU Voxels X-Mas Edition

Happy Holidays everyone!

Just for Christmas I finished the latest Release of GPU-Voxels which brings an amazing new feature:
Realtime distance field computation on large pointclouds (thanks to Christian Jülg)!!

Have a look at the Distance-Kinect example and have fun to inflate your avatar pointcloud (:
I already used this feature to implement a reactive inverse kinematics function for highly articulated robots, so that the robot maximizes free space which reaching a goal. Also we used the distance field to navigate a flying drone through a maze while keeping clearance to all obstacles (Video).

Of course there have been a bunch of Bugfixes and some more new features, so find the changelog below.
Download as always at: https://github.com/fzi-forschungszentrum-informatik/gpu-voxels

 

All the best to you for 2017,

Andreas

 

 

V 0.93 (2016-12-24):
====================
API breaking changes:
- Multiplying a vector<int> with an int scalar now gives a vector<int>
- Removed offset when colliding VoxelLists as implementation was faulty
- Unified CTor of VoxelLists and VoxelMaps
- Unified spelling of insertPointcloud ==> insertPointCloud

Major changes:
- Added DistanceField calculations (thanks to Christian Jülg)
    - New DistanceVoxelMap type
    - Re-implementation of the Parallel Banding Algorithm (Original by Cao Thanh Tung)
    - Added according example and test cases
- Added BitMasked collision check and testcase for BitVoxels
- Implemented a HeighMap loader to populate 3D worlds from Bitmap files
- Added insertPointCloudIntoMap() to HighLevel-API
- Added collision functions between BitVectorVoxelList and BitVectorVoxelMap
- Improved Mutex-Locking (thanks to Christian Jülg)
    - No more busy waiting
    - Recursive locking now possible
- Reworked Boost-Tests to function as Benchmarks (Thanks to Herbert Pietrzyk)
- Improved BitVector code
    - Fixed error in Bit-negation
    - Added according testcase
- Fixed defaultCollider for BitVoxels (counted eBVM_FREE as collision previously)

Minor changes:
- Added screendump function for VoxelLists
- Fix in CMake to export CUDA dependency
- Restructured optional dependency management
- Improved the handling of warnings within Kernels (less printf spam)
- Visualizer config files: Added option to set color for all BitVoxelMeanings at once
- Consistently using RPY for geometry generation (instead of YPR formerly)
- Improved BitVoxelLists operations
    - Thrust performance optimization
    - Added according testcase

Other changes:
- Now compiles with CLang (fixed ambigous names)
- Improved docs
- Improved tescases for VoxelLists
- Fix for CUDA 7 on Ubuntu 16.04 (-D_FORCE_INLINES)
- Added UR10 & Robotique FTS model (10% larger, voxelized at 4mm)
- Added Pelican UAV model
- Corrected copy paste errors in CMake IC_BUILDER defines
- Removed own source version of TinyXML: Now using system lib
- Updated icmaker build tools
- Updated QT include dirs in icl_core
- icl_performance_monitor got some new functions
Read more | Comments Off on X-Mas Release (v0.93) – Distance Fields | Dec 25, 2016

Smaller update about math (v0.92)

And again: There is a new version on GitHub.
It now centralizes the math functions directly where you would expect them: Within the datatypes.
Of course this breaks existing code, but it is straight forward to fix. Just call the functions which previously existed in the gpu_voxels namespace on the datatype (e.g. .toRPY() on a Matrix3f).
The datatypes itself stay untouched.

And have a look at the wonderful new Readme which now comes in Markup ((:

 

Cheers, Andreas

Read more | Comments Off on Smaller update about math (v0.92) | Sep 16, 2016

Example on how to link against GPU-Voxels (v0.91)

Hello everyone!

I just pushed the 0.91 release of GPU-Voxels to GitHub.
It now includes an example on how to link against the lib via plain CMake.
(It also fixes a minor bug and allows you to visualize pointclouds as PrimitiveArrays).

Hope that helps!
Andreas

Read more | Comments Off on Example on how to link against GPU-Voxels (v0.91) | Sep 14, 2016

Release 0.9 is out

Hi everyone!

Finally I could release a new version of GPU-Voxels at https://github.com/fzi-forschungszentrum-informatik/gpu-voxels!
The release introduces a bunch of new features and makes everything more stable.
Also it compiles on Ubuntu 16.04!
Two little things are on the negative side:
– You probably need to patch your GLM library (see this issue: https://github.com/g-truc/glm/issues/530 )
– The update breaks some API functions, but it should be easy to adapt in your code.

 

Cheers,
Andreas

 

Here is the rather long changelog:

V 0.9 (2016-08-21):
===================
API breaking changes:
 - GpuVoxels is now a singleton and has to be initialized
 - BitVoxelMeaning enum changed! 0 = Free, 1 = Occupied. More SV IDs.
 - Added as() operator to cast general maps into specific maps
 - Map-Offsets may now be negative, so Voxel-pointers changed datatype.
 - Shifted main API from general map type to specific implementations:
 Many functions can no longer be called on basic map types but only on
 specific maps. As not all map types offer all interfaces, this allowed
 us to remove unimplemented function stubs (thanks to Herbert Pietrzyk)
 - RPY rotation order changed to ROS standards:
 First rotated around roll, then pitch, then yaw
Major changes:
 - Unified map-locking for all map types to guarantee thread-safety
 - Added new Pointcloud class for single clouds (thanks to Herbert Pietrzyk)
 - Added Octree-API function: insertPointCloudWithFreespaceCalculation
 to trigger raycasting
 - Added option to interpret unknown cells of an octree as obstacles
 when checking collisions
 - Added tfHelper class to interact easily with ROS tf
 - New Math functions:
 - Added host function to invert matrices.
 Code thankfully copied from Maxim Singer
 - Function to convert Mat4 to Roll, Pitch, Yaw
 together with Boost tests
 - Vector3f now offers: apprx_equal, length, normalize, dot, cross
 - angleBetween two vectors, orientationMatrixDiff between two matrices
 - Matrix4f now offers: equality, approximate equality and subtract
 together with Boost tests
Minor changes:
 - Added visualizer config file and a python generator for random swept
 volume colors (this time for real)
 - New Boost testcases for Pointclouds and MetaPointClouds
 - Simplified sensor code for Raycasting in Octree
 - Restructured keyboard shortcuts in visualizer:
 - Added "command mode" to switch between data types so
 all Function keys can toggle maps of the selected kind.
 - Using ALT+digit to set decimal preposition of SweptVol IDs
 - Right-Click available for more datatypes in Visualizer to
 print voxel information
 - Fixed updates of subclouds in MetaPointClouds
 - Added sanity check in computeLinearLoad
 - Added Getter functions for GVL parameters
 - Added some general HTML pages to Doxygen docu (thanks to Darius Pietsch)
 - Unified probability type in all maps
 - Fixed memory leaks in MetaPointCloud
 - Added Kernel for GPU memory comparison
 - Unified geometric transformation kernels
 - Clarified singed and unsigned voxel indices (thanks to Christian Juelg)
 - GPU Voxels main class now checks for Compute Capability at init
 - Added PointCloud constructor to load file
Other changes:
 - Compiles with Ubuntu 16.04
 - Added CMake macro to remove VTK defines
 - Required lib glm fix: https://github.com/g-truc/glm/issues/530
 - Added enlarged UR5 model
 - Updated list of contributors
Read more | Comments Off on Release 0.9 is out | Aug 25, 2016

New videos available

Hi everyone,

I just wanted to announce two new videos:

Video Preview of Shared Workspace

The YouTube video shows an application scenario with a shared workspace where the motions of the robot (represented as temporally encoded Swept-Volumes) are monitored via two Kinect cameras. As soon as an obstacle is detected in the upcoming trajectory, the robot stops and chooses another (collision free) subtask to execute. GPU-Voxels acts as some kind of relay between ROS MoveIt and the robot controller, so that planned motions can be monitored online.
Video preview of predictive collision detection.

This video (third one on the linked demos page) shows our work on predictive collision detection: We analyze motion in RGB-D video input and project objects movements into the future.
This generates a Swept-Volume that can be intersected with the Swept-Volumes of planned robot motions to anticipate probable upcoming collisions.
Big thanks to Felix Mauch for his great work on this toppic!
For further info please read our paper or contact me.

A. Hermann, F. Mauch, K. Fischnaller, S. Klemm, A. Roennau, R. Dillmann,
“Anticipate your surroundings: Predictive collision detection between dynamic obstacles and planned robot trajectories on the GPU”
in European Conference on Mobile Robotics (ECMR 2015, Lincoln, September 2015)

We are also making progress on bringing GPU-Voxels to a flying drone scenario, mobile platforms (motion primitive planning in simulation is already up and running) and into real-time grasp planning. So stay tuned!

Cheers,
Andreas

Read more | Comments Off on New videos available | May 6, 2016