OptiTUIO Manual

Introduction

OptiTUIO™ is a tool to calibrate optical LIDAR sensor devices. With OptiTUIO™ it is possible to use laser contour scanners like the Leuze ROD4plus, Hokuyo sensors or the Sick LMS models for controlling any number of applications. OptiTUIO™ generates and detects unlimited touch points which then can be detected and processed by compatible applications and devices. OptiTUIO™ has 3 different output modes, TUIO, Mouse and Windows Touch.That means that any application which understands TUIO, Mouse or Windows Touch can get controlled with OptiTUIO™. With our solution you literally transform any flat surface into a multitouch surface.

Features

• Simplicity The software is very easy to use. The calibration process is finished after a few minutes. You can see what you are doing and the effect it has in realtime, so there is no need for time consuming switching between calibration and testing like in other solutions.

• Live preview You can see in realtime what you are doing. Our live preview shows you exactly where your sensor is placed and where your screen is placed. Fine-tuning is very easy to realize.

• Unlimited touch points We did not put any artificial limit on the number of simultaneous touch points.You can track as many as you want. The upper limit is a result of the angular resolution of the laser and the minimal object size that you set to detect.

• Many output methods Right now the software supports output to TUIO compatible devices over the network and to simulate Windows mouse and/or touch input to control a local Windows application. We also provide a separate application to perform gesture detection to control PowerPoint using swipes for example. Contact us if you need anything specific.

• Vendor independence Our software works with most of the common LIDAR sensors. This gives you the flexibility in choosing the device that fits best for your project and budget. Depending on which sensor you choose you can get up to 50 meters of detection radius with just one sensor. If there is a new sensor on the market we will try to implement it by request. See Section 3.3, “Supported LIDAR sensors” to find more.

• Multiple outputs Each output can be sent to one ore multiple different outputs. Giving you full flexibility in how to distribute them. You can also define multiple outputs to send the data of one device to many target machines, this is useful for cluster setups.

• Highly optimized detection algorithms We spent a long time building and analyzing statistics of the accuracy of the devices to optimize our filters to get the most accurate tracking possible. For each device we acquired millions of data points to get an accurate statistical analysis. This is why we are able to get a fully stable input without any jitter in the measurement. We took much care to keep the impact on latency minimal and you can tune the filter parameters yourself to get a different trade off between smoothness and latency.

• Multilingual User Interface To make it easier for any user to understand and use OptiTUIO. For now the following languages are available in the GUI (Graphical User Interface):
  • English
  • German
  • Chinese
  • French

We will translate the software into more languages if there is the need.

System and hardware requirements

Supported operating systems

• Mac OS X 10.11 El Capitan or newer
• Windows 7 or newer
• Ubuntu 16.04 Xenial Xerus or newer
• Debian 8 Jessie or newer

Hardware requirements

• A recent x86 or x86-64 CPU supporting SSSE3
  • Intel starting from Core 2 and Atom
  • AMD starting from Bobcat APU
  • VIA starting from Nano
• At least 100 MiB of free HDD space
• At least 256 MiB of free RAM
• For the calibration software an OpenGL 2.0 compatible graphics card is required

Supported LIDAR sensors

• Hokuyo UST-10LX
• Hokuyo UST-20LX
• Hokuyo URG-04LX
• Hokuyo UTM-30LX
• Leuze ROD4 plus series
• Sick LMS 1xx series
• Sick LMS 5xx series

						Basically any Hokuyo sensor which is supporting the SCIP 2.0 protocol should be working

						For the Hokuyo UST-10LX and UST-20LX, make sure that the device is running at least the 2.21 Firmware which can be obtained from the Hokuyo website.

Installation

Windows

On a windows machine there is no need to install OptiTUIO™. You will get a zip archive which contains the folders explained below. Then you just need to start the application with a double click.

						Make sure that you install the Visual C++ runtime. You can find the vcredist_x64.exe in the OptiTUIO™ bin32 or bin64 folder. If the Runtime is not installed OptiTUIO™ will not start.

Folders

After you downloaded the latest OptiTUIO™ release you have to extract the archive first. In the extracted folder you can find the following folders:

• The bin32 folder holds the 32bit files.
• The bin64 folder holds the 64bit files.
• The docs folder holds software licensing information and the latest release notes in the CHANGES.html

In the bin32 or bin64 folder you can find then the following files:

In this folder you can find the main OptiTUIO applications and the Visual C++ runtime:

• OptiTUIO.Calibration.exe (the main calibration application)
• OptiTUIO.Server.exe (the runtime / server application)
• vcredist_x64.exe (Visual C++ runtime)

						We suggest to run the software during shows with the server application. After you saved the calibration with the calibration application just start the server application and choose the saved calibration file.

Setup & Calibration

This chapter describes the whole process of the calibration with the OptiTUIO.Calibration.exe including how to install the license.

Quick Start

This is a short intro for a quick setup of OptiTUIO™:

• Connect the sensor to your machine and make sure that the machine can communicate with the sensor (Pingtest)

						The sensor has to be in the same network as the machine which is running OptiTUIO™

• Start OptiTUIO™ and Add your sensor in the Devices Tab
• Click the Info button to get the serial number of your device. Send this serial number to info@interactiveasia.com to receive your purchased license.
• Start the sensor with the Start button under the Devices tab. If the sensor scans correctly you can see the blue scan area in the sensor view.
• Add your screen and setup the dimensions of the screen
• Assign the screen to the sensor in the Devices tab und Screen in the Settings
• Add your desired output
• Now OptiTUIO™ is working and you should be able to get a touch feedback already depending on the output you defined.

First Start

Double click the OptiTUIO.Calibration.exe

The Graphical User Interface of OptiTUIO™ will start

The GUI has the typical menu bar, the sensor view and the tab area.

In the menu bar you can load, safe and create new calibrations.

You also can adjust the view and under the Help menu you can install the license and get more information's about OptiTUIO™ and the license.

In the sensor view you will see the contour of the scanned area when the senor is scanning. In the tabs area you do the main calibration and adjustments.

In the bottom left corner you will see the scan frequency of the running sensor.

						If OptiTUIO did not start make sure that the Visual C++ runtime is installed on your system. You can find the latest release of the Visual C++ runtime in the OptiTUIO folder. Check chapter 4.1 Folders.

						Check the hardware specifications and Operating System requirements if you have any trouble to start OptiTUIO. Find this in Chapter 3.

Read out the serial number of your sensor

To create your license we need to have the exact serial number of your sensor. You can read it out with OptiTUIO™. Click the Info button in the Devices tab. A popup will appear with your sensors unique serial number.

Install the license

Until now (OptiTUIO™ Version 20190126_V1-2-3) our license system is based on a soft license. That means we will create a license file for you which you then have to assign in OptiTUIO™. The license file is bound to your sensors serial number. Means you can use the device license on any computer with the licensed sensor. If you have more then one sensor and also bought the license for all the sensors then we can create you a license file which contains all the licensed sensors. You can install the license file under the menu item Help -> Install license.

Additionally we offer a online demo license which can work with any connected sensor. Requirement for this is that the machine which runs OptiTUIO™ is connected to the internet.

After you successfully installed the license you can check under Help -> View License more details about your installed license.

						The demo license is not for commercial use. It is for testing purpose only!

						You can install the license on any machine and Operating system which is supported by OptiTUIO.

Add a sensor

Add your sensor in the devices tab.

						The Hokuyo UST 10 LX, Hokuyo UST 20LX and the Hokuyo URG04 can be added via the Hokuyo URG item. This item includes all the Hokuyo sensors.

Settings of the sensor

Here we describe the settings of a Hokuyo UST 10 LX sensor. The settings are very similar with other sensors.

Once you added a sensor in the Devices tab the icons above the sensor list will be activated and the properties of the sensor will get available on the right side under the settings area.

This is the control panel to add, remove, start and stop the sensor.

• Add - this button opens the available sensor list where you can choose your sensor
• Remove - this button removes the selected sensor
• Start - Starts the sensor and the sensor will start scanning. If the sensor is runnig you can see the blue scanning area in the sensor view window
• Stop - Stops a running sensor and the sensor will stop scanning
• Info - This button shows you the serial number of the connected sensor. This button just works if the sensor is not running and connected correctly.

						If you connected a sensor you can read out the serial number of the connected sensor via the Info button

On the right side you have access to the settings of the specific sensor:

• Name - Here you can give your device a name
• Connection - By default the connection is set to Network. If you use the Hokuyo URG04 with a USB connection then you have to change this value to serial
• Offset X - Offset the sensor in X direction (left / right)
• Offset Y - Offset the sensor in Y direction (up / down
• Rotation - Adjust the Z rotation if your sensor is offset in Z direction
• Kahlman - Maximum deviation of the measured values to the actual distance. It is recommended to use the default values per device.
• Smoothing - This value will make the control smoother. But the higher the value is they more delay you will get.
• Screen - Here you have to assign the screen which you have created under the Screens tab.
• Flip x/y - Depending on the orientation of the sensor you can flip the values in X and Y

						If you have not assigned the screen under the Devices tab you will not get any touch output

Start the sensor

1. Make sure that your sensor is connected correctly. You have to make sure that the computer which is running OptiTUIO™ is in the same sub network like the sensor.
2. The Hokuyo UST 10LX has by default the IP address 192.168.0.10
3. Make sure that your computer is in the same network or change the IP address of the sensor to your desired IP address.
4. If you are able to ping the sensor via ping 192.168.0.10 then OptiTUIO™ will be able to connect to the sensor too.
   1. You can ping the sensor if you open a cmd window in Windows Windows Key + r. Then type cmd in the Run Window and press Enter.
   2. In the command window type ping 192.168.0.10 or the correct IP address of your sensor.
   3. If you get a positive feedback from the sensor OptiTUIO™ will be able to connect to the sensor.
5. Select the sensor in the Devices tab and click Start in the control panel.
6. Once the sensor is started you can see the blue scan area in the sensor view.
7. In the bottom left corner of the GUI you can also see the scanning frequency of the sensor.

Setup the screen

Click the Screens tab and then the Add button to add a new screen. Then setup the Size X (width) and the Size Y (height) of the screen in millimeters.

• Name - Setup a name for your screen
• Size X - The width of the physical touch screen area in mm
• Size Y - The height of the physical touch screen area in mm
• Offset X - offset the screen left or right in relation to your device
• Offset Y - offset the screen up or down in relation to your device

Setup the output

In the Output tab you can setup your desired output. OptiTUIO supports TUIO, Windows Touch and Mouse control.

Select your desired output

• TUIO - This will setup an TUIO output which then will directly send TUIO informations to the specified address and port.
• Mouse - This will simply control the computer mouse
• Windows touch - With this output you can simply control Windows touch
• Raw distance - This is a special output which sends RAW distance values to a specific OSC address

TUIO output

TUIO is a network protocol designed for transmitting MultiTouch input data. It is the de-facto standard for receiving information from MultiTouch devices. Any application which understands TUIO will be able to communicate directly with this output. Typical applications are Ventuz, Unity, VizRT, UE4 and many other media servers or playout applications.

The following list describes the settings of the TUIO output.

• Name - Here you can assign a name for your output
• Host - The machine where OptiTUIO™ will send the TUIO informations (default: localhost / 127.0.0.1)
• Port - The port on the host machine where OptiTUIO™ will send the TUIO informations (default: 3333)
• Screen - If you have more then one screen then you can define from which screen the TUIO information's will come (default: All)

Mouse output

The mouse is the primary input device used to interact with objects in Windows, Linux and MacOS. This output will simply control your mouse pointer. There are two different control options with the windows mouse.

The following list describes the settings of the Mouse output.

• Name - Here you can assign a name for your output
• Offset X - Here you can offset your mouse pointer in X direction.
• Offset Y - Here you can offset your mouse pointer in Y direction.
• Size X - This value is set automatically if you start OptiTUIO™. It is the width in pixel of the screens you have connected to your computer. You can change this values if you just want to control one screen.
• Size Y - This value is set automatically if you start OptiTUIO™. It is the height in pixel of the screen you have connected to your computer.
• Screen - If you have more then one screen then you can define from which screen the Mouse information's will come (default: All)
• Mode - Simple and Two click.
  • The simple mode uses the first touch point and moves the mouse directly to that position and executes a left click.
  • The two click mode uses the first touch point to move the mouse pointer without any click action. If you hold your first finger in the screen then you can create a Left click if you touch with your other hand left side of the first hand. Or a right click if you touch right side of your first hand which controls the point.

						The mouse just can be controlled with one touch point. Or in the two click mode with maximum two touch points. There is no way to control two mouse pointers with one OS.

Windows touch output

New hardware and API elements in the Windows 7 operating system provide applications the ability to receive input from multiple contacts. This gives such applications the ability to detect and respond to multiple simultaneous touch points on the application's visible surface. This output of OptiTUIO™simply gives you the ability to control your computer via Windows touch. Please find more information's on the Windows website: About the multi touch SDK

The following list describes the settings of the Windows touch output

• Name - Here you can assign a name for your output
• Offset X - Here you can offset your mouse pointer in X direction.
• Offset Y - Here you can offset your mouse pointer in Y direction.
• Size X - This value is set automatically if you start OptiTUIO™. It is the width in pixel of the screens you have connected to your computer. You can change this values if you jaust want to control one screen.
• Size Y - This value is set automatically if you start OptiTUIO™. It is the height in pixel of the screen you have connected to your computer.
• Pressure -
• Radius -
• Screen - If you have more then one screen then you can define from which screen the Windows touch informations will come (default: All)