|
|
| (38 intermediate revisions not shown) |
| Line 1: |
Line 1: |
| | Random tidbits of information about projects I'm hacking on... | | Random tidbits of information about projects I'm hacking on... |
| | | | |
| - | ==multi-point-touch==
| + | * [[User:Jketreno/multi-point-touch|Multi-Point-Touch on MeeGo]] |
| - | During the MeeGo Conference I gave a presentation on multi-point-touch support on MeeGo ([http://conference2010.meego.com/session/multi-touch-meego-hardware-user overview and video] [http://conference2010.meego.com/sites/all/files/sessions/meego-conference-2010-multi-point-touch.odp slides]). As mentioned during that presentation, to add multi-point-touch to Qt applications running on top of MeeGo 1.1 requires a few changes.
| + | * [[User:Jketreno/content|Improving MeeGo Content Management]] |
| - | | + | * [[User:Jketreno/scaling|A Density Independent UI on MeeGo]] |
| - | The components that need to be changed are:
| + | * [[User:Jketreno/theme-assets|Theme Assets]] |
| - | * Kernel -- You need kernel touch drivers that are in sync with upstream | + | * [[User:Jketreno/meego-image-resize|MeeGo Image Resize script]] |
| - | * Qt -- You need a version of Qt that does not have the RX71 code path enabled
| + | |
| - | | + | |
| - | New components:
| + | |
| - | * mtdev -- Library to translate kernel protocol A and B to protocol B, adding tracking information
| + | |
| - | * xf86-input-mtev -- X input driver that communicates with mtdev to obtain multi-point data from the kernel | + | |
| - | * multipointtouchplugin -- in-application plugin which hooks to the Qt input event filter to process XInput events sent from xf86-input-mtev and injects QTouchEvent's into the Qt event queue
| + | |
| - | | + | |
| - | To get the above, you can add my home project:
| + | |
| - | cd /etc/zypp/repos.d
| + | |
| - | sudo wget http://download.meego.com/live/home:/jketreno/Trunk/home:jketreno.repo
| + | |
| - | sudo sed -i -e 's,^gpg,#gpg,g' home:jketreno.repo
| + | |
| - | zypper refresh
| + | |
| - | | + | |
| - | Next, force a re-installation of the packages provided from my home project:
| + | |
| - | zypper install -f --from=home_jketreno kernel_netbook libqt* qt-qmlviewer mtdev \
| + | |
| - | xf86-input-mtev multipointtouchplugin
| + | |
| - | | + | |
| - | It will prompt you to switch to the versions of the various packages provided from the above repository. Accept the changes, and reboot.
| + | |
| - | | + | |
| - | ==enabling a native application==
| + | |
| - | The mechanism to talk to the xf86-input-mtev driver is not merged into the Qt package itself. Until that occurs, applications interested in working with touch events need to add the following to the beginning of their application, within the '''main()''' function:
| + | |
| - | foreach (QString path, QCoreApplication::libraryPaths()) {
| + | |
| - | QPluginLoader loader(path + "/libmultipointtouchplugin.so");
| + | |
| - | loader.load();
| + | |
| - | if (loader.isLoaded()) {
| + | |
| - | loader.instance();
| + | |
| - | break;
| + | |
| - | }
| + | |
| - | }
| + | |
| - | At the beginning of the file, you also need to include QPluginLoader:
| + | |
| - | #include <QPluginLoader>
| + | |
| - | And that's it.
| + | |
| - | ==enabling a QML application==
| + | |
| - | The version of qmlviewer built and installed with the Qt package in my home project has the above code enabled, providing Touch events into qml applications run within qmlviewer. If you are loading your QML application using your own native loader, you will need to follow the steps above for '''enabling a native applications'''.
| + | |
| - | ==qml-gesturearea==
| + | |
| - | As Frederik Gladhorn indicated during [http://conference2010.meego.com/session/gestures-qt his talk] at the MeeGo Conference in Dublin, the folks over at Qt have been working on an improved QML GestureArea component.
| + | |
| - | | + | |
| - | You can pull and play with what they're cooking as follows:
| + | |
| - | git clone git://gitorious.org/qt-labs/qml-gesturearea.git
| + | |
| - | git clone git://gitorious.org/qt-labs/qml-gestures-examples.git
| + | |
| - | To build qml-gesturearea, you may need to patch it (I did):
| + | |
| - | cd qml-gesturearea
| + | |
| - | sed -i -e 's,q->timeout(),700,g' qdeclarativegesturerecognizers.cpp
| + | |
| - | qmake
| + | |
| - | make && sudo make install
| + | |
| - | Assuming you are using the qmlviewer provided with qt-qmlviewer in my home project, you should then be able to run the following:
| + | |
| - | qmlviewer ../qml-gestures-examples/dashboard/MainWidget.qml
| + | |
| - | and interact with the example.
| + | |
| - | | + | |
| - | ==how multipointouchplugin works==
| + | |
| - | The multi-point touch plugin is intended to proof out multi-point touch interaction with Qt, without having to make invasive changes to Qt 4.7 itself. Ultimately, by MeeGo 1.2, we need to create a patch to Qt deployed on MeeGo such that each application does not have to load the plug-in.
| + | |
| - | | + | |
| - | Internally, the plug-in (in the MultiPointTouch constructor) first make sure the XInput extension exists and supports version 2.0 of the protocol.
| + | |
| - | | + | |
| - | When an X FocusIn event is received, the plugin walks through all of the available input devices looking for any that expose a valuator with the "Abs MT Tracking ID" label. Any X input device using xf86-input-mtev will expose this data. For each device found, it subscribes to button press, release, and motion events.
| + | |
| - | | + | |
| - | When an X FocusOut event is received, the plugin walks through all of the available input devices looking for any that expose a valuator with the "Abs MT Tracking ID" label. Any X input device using xf86-input-mtev will expose this data. For each device found, it clears the event mask
| + | |
| - | The plug-in then inserts itself into the QCoreApplication's event filter via setEventFilter().
| + | |
| - | | + | |
| - | The plug-in's registered eventFilter does a few checks to determine that an inbound event is the correct type, and if so, it then calls a method to translate the event to Touch events (translateEvent)
| + | |
| - | | + | |
| - | Within translateEvent, the valuators are parsed, scaled, and set onto list of active QTouchEvent::TouchPoint's.
| + | |
| - | | + | |
| - | If each touch point is immediately fed into the Qt input queue, via qt_translateRawTouchEvent, input becomes very laggy and the Qt application behaves very sluggishly. So, each of the TouchPoints is instead placed into a pending queue and then all events remaining in the Qt input queue are processed via processEvents(). Once that returns, the batch of queued touch events are dispatched.
| + | |
| - | | + | |
| - | ==core pointer==
| + | |
| - | If you do nothing, X will default to binding the touch device to the Core Pointer. This means that as you move your finger around, mouse events will be generated, the cursor will move, etc. To fix that, you can use the xinput utility to "float" the touch device. On the Lenovo S10, running 'xinput list' shows something like the following:
| + | |
| - | | + | |
| - | ⎡ Virtual core pointer id=2 [master pointer (3)]
| + | |
| - | ⎜ ↳ Virtual core XTEST pointer id=4 [slave pointer (2)]
| + | |
| - | ⎜ ↳ Cando Corporation Cando 10.1 Multi Touch Panel with Controller id=13 [slave pointer (2)]
| + | |
| - | ⎜ ↳ SynPS/2 Synaptics TouchPad id=16 [slave pointer (2)]
| + | |
| - | ...
| + | |
| - | | + | |
| - | Looking at the above, you can see the touch device (Cando Corporation...) is device id 13. To float that input device, run:
| + | |
| - | | + | |
| - | xinput float 13
| + | |
| - | | + | |
| - | and verify that touching the screen no longer moves the mouse pointer.
| + | |
| - | | + | |
| - | That change, combined with the FocusIn/FocusOut mechanism in the multipointtouchplugin means that window focus will have to be given to windows via an actual mouse pointer (since X will no longer be parsing touch input as an Core pointer input device) or by other means (pressing the application in the app switcher, for example)
| + | |