This page is frozen, 
actual one here.OpenSCADA adaption to the software platform "Android"
| Name: AdaptAndroid Founded: February 2017 Status: Android specific expandings of the project OpenSCADA. Achievement: Packs to APK packages by CrystaxNDKr10 (>= ABI 19, Android 4.4) and NDKr13 (>= ABI 21, Android 5), starts and works through JNI through the WWW and Qt5, tested on DB.Model.AGLKS.Current difficulty, spent time: 18 (Android) + 4 (OpenSCADA and core libs) + 6(Qt5) days Members: Roman Savochenko Description: The sub-project's purpose is to adapt the project OpenSCADA to run on the software platform Android which wide used on more mobile, TV, SmartWatch and other devices. Task: http://oscada.org/en/development/tasks/posts/tasks_forming_formirovanie_zadach/openscada_adapting_to_the_android_os_tablet_asus_nexus_7_ii_workout. |  |
Introduction
Android is an operation system initially developed by Android Inc., which Google bought in 2005, Android was unveiled in 2007, along with the founding of the Open Handset Alliance — a consortium of hardware, software, and telecommunication companies devoted to advancing open standards for mobile devices.Android's kernel is based on one of the Linux kernel's long-term support (LTS) branches. Since April 2014, Android devices mainly use versions 3.4, 3.10 or 3.18 of the Linux kernel.
Android is far away from a Linux distribution by it does not include the GNU C Library (it uses Bionic as an alternative C library) and some of other components typically found in Linux distributions. Moreover it has a graphical and application stack built on Java VM which excludes initially writing any other program than on the Java language. But in the performance reason JNI uses here to link external native libraries written on C/C++ by a native development kit (NDK). But the LibC Bionic and the core libraries are mostly POSIX compatible. Due more lacks and more limitations into the original Android NDK there was used an user expanded one
CrystaX NDK, but last stable version of CrystaX NDK based on NDK r10 and on the task time there allowed original version r13, where more lacks resolved but the native functions of locales still lack.For developers Google provides
Android software development kit (SDK). All projects written to build by Android Development Tools (ADT) and the IDE Eclipse allowed to the packages assemble from the command line and then can be automated, but new projects (see to the current samples) written on/for Android Studio can be built only from the environment and without the command line using. The sub-project implements and tests on Asus Nexus 7 II with the original Android 4.4.4 (Krait) then there uses Andoid-19 SDK version.Before an action for same OpenSCADA adaption there were read some books, learned some links, created several examples and executed some tests, those are:
- Read books:
- "Android NDK Beginner's Guide — Second Edition", Sylvain Ratabouil;
- "Android Native Development Kit Cookbook", Feipeng Liu.
- "
- Learned links:
- Built examples from the books, links and Qt5:
- By ADT into the command line or Eclipse IDE: "san-angeles" (sample), "Store", "DroidBlaster", "LiveCamera", "PortingExecutable", "PortingExecutableBuildSystem", PortingExecutableAUI
- By Android Studio: "native-activity" (sample), "Store"
- Qt5 examples: "analogclock", "calculator", "charactermap", "icons", "styles".
- Built and executed for tests of features of the system:
- arm_test.cpp — alignment tests of the ARM architecture;
- locale_test.cpp — time tests with a time zone or UTC;
- precision_test.cpp — tests for precision of the tasks scheduling (SCHED_RR) in realtime;
- printf.cpp — tests for performance of different locks: direct RW lock to RD and RW, RW lock wrapped to an object, direct mutex, mutex wrapped to an object.
- string.cpp — tests for some operations on STL string with exceptions processing.
- task_test.cpp — tests for threads.
Due the method of linking of native programs is the primarily and exclusively only through JNI by connecting a share library then all dependent code of the program must be placed and pre-loaded into shared libraries against the common one or builtin as the static parts to the common one. Placing and loading the dependent code as the shared libraries will cause to extra memory consumption but it's will exclusively the program's libraries. Then compiling the dependent libraries of the program as the static ones is a preferred way for Android!
OpenSCADA
To simplify and early preparing OpenSCADA to JNI in all its parts there is decided to build the program as a native executable and start it from the command-line. Then:- To prepare a standalone toolchain for CrystaxNDK r10 there is used the command:
- To init the compiler and the linker there forms an environment preparing script with the SoftFloat and HardFloat flags:
- To init the compiler directly into the CrystaxNDK r10 tree with the SoftFloat and HardFloat flags:
- To init the compiler directly into the for NDK r13 tree with the SoftFloat and HardFloat flags:
- Before same OpenSCADA compile we need compile:
- the PCRE library by the command:
- the OpenSSL by the command:
- Call and compile OpenSCADA configuration by the command:
- Copy files "openscada", "liboscada.so.3", "libcrystax.so", "spec_SystemTests.so", "oscada.xml", "icons/*.png" to "/data/data/openscada/".
- Start:
Current compiling and adapting status of the OpenSCADA core, it parts and the dependent libraries condensed and placed to the next table:
| Part | Compiling standalone executable Qt5 and JNI CrystaxNDKr10 Original NDK r13 ABI21 (Builtin for modules) | Tests | Commentaries and problems |
| The dependent libraries | |||
| PCRE, for the core | OK OK OK | Configuring command: | |
| OpenSSL, for: Transport.SSL, DAQ.OPC_UA, Special.FLibSYS (opt) | OK OK OK | Configuring command: | |
| LibGD, for: the core (opt), UI.WebCfgD (opt), UI.WebVision | OK OK OK | Dependent from: libpng, jpeg, freetype, fontconfig Also has links to macro __GNUC_PREREQ which missed on Android => a workaround placed to "features.h": Configuring command: | |
| -> libpng | OK OK OK | A version of "libpng" used from CrystaX and built for Original NDK r13 by a configuring command: | |
| -> jpeg | OK OK OK | A version of "libjpg" used from CrystaX. and built for Original NDK r13 by a configuring command: | |
| --> expat | OK OK OK | Configuring command: | |
| --> freetype | OK OK OK | Configuring command: | |
| -> fontconfig | OK OK OK | Configure for proper folders of the fonts. | Configuring command: |
| libfftw3, for UI.{Vision,WebVision} (opt), Special.FLibSYS (opt) | OK OK OK | Configuring command: | |
| libiconv, for the core (opt) | OK OK OK | Successful built and used an external library. Configuring command: Builtin one into CrystaX wrong and unfinished. | |
| libintl (gettext), for the core (opt) | OK OK OK | configure.ac fixed to check symbol libintl_bindtextdomain into the library "libintl" and the symbol "libiconv_open" into the library "libiconv" checking before. Successful built and used the external "libiconv". Needed for "iconv" implementation but into CrystaX it is broken: CRYSTAX_PANI: issetugid() not implemented!!! Configuring command: | |
| libcrypt (GlibC), for the core (opt) | ? | ||
| libQt5, for UI.{QTStarter,QTCfg,Vision} | OK OK OK | Too specific for configuration and have some building's bugs, then it has fixed and adapted to architecture "armeabi-v7a-hard", for details see here. Due the problems with armeabi-v7a-hard the building was fully switched to armeabi-v7a but with parameters "-march=armv7-a -mfloat-abi=softfp -mfpu=vfp"! Configuring command (hard-float): Most the patched problems of building Qt5 has for Crystax NDK r10 and has not for Original NDK r13. Also Qt5 has significant problems of look (font's size and images show) at it building for hard-float! See details into the proper section. Configuring command (soft-float): | |
| OpenSCADA | |||
| Generic and the core library | OK OK OK |
|
|
| DB.SQLite | OK OK OK |
|
A version of "libpng" used from CrystaX and built for Original NDK r13 by a configuring command for version 3.8.7.1: |
| DB.DBF | OK OK OK | Execute the DB tests. | |
| DAQ.JavaLikeCalc | OK OK OK | Performance tests. | |
| DAQ.LogicLev | OK OK OK | - | |
| DAQ.BlockCalc | OK OK OK | - | |
| DAQ.DAQGate | OK OK OK | - | |
| DAQ.System | OK OK OK (as a module) | Create an automatic controller object and see for what sources are allowed. | Allowed types of sensors: "CPU", "Net statistic", "Memory", "HDD statistic", "Up time". |
| DAQ.ModBus | OK OK OK | - | |
| DAQ.DCON | OK OK OK | - | |
| DAQ.OPC_UA | OK OK OK (as a module) | Create an input transport, an endpoint and connect remotely to it. | Adapted to include/builtin into the OpenSCADA core. |
| Archive.FSArch | OK OK OK | - | |
| Archive.DBArch | OK OK OK | - | |
| Transport.Sockets | OK OK OK | Configure an input transport to remote connect to it. | The function getservbyname_r() switched to getservbyname() for Android. |
| Transport.Serial | OK OK OK (as a module) | - | Checking for linux/serial.h added and for linux/i2c-dev.h fixed. |
| Transport.SSL | OK OK OK | Configure an input transport to remote connect to it. |
|
| Protocol.SelfSystem | OK OK OK | Remote connect to it. | The dependence to "libcrypto" of OpenSSL moved to be optional. |
| Protocol.UserProtocol | OK OK OK | - | |
| Protocol.HTTP | OK OK OK | - | |
| UI.VCAEngine | OK OK OK (as a module) | ||
| UI.QTStarter | OK OK OK (as a module) | Adapt to start up from JNI. | |
| UI.QTCfg | OK OK OK (as a module) | ||
| UI.Vision | OK OK OK (as a module) | ||
| UI.WebCfg | OK OK OK (as a module) | ||
| UI.WebCfgD | OK OK OK (as a module) | Move the images to the OpenSCADA folder and try its and the module. | A strong dependence from GD removed. |
| UI.WebVision | OK OK OK (as a module) | The library LibGD test on a trend of the primitive "Diagram" and a widget of the primitive "ElFigure" of the project AGLKS. | Dependence to LibGD expanded by: -lpng -ljpeg -lfontconfig -lexpat -lfreetype |
| UI.WebUser | OK OK OK (as a module) | ||
| Special.FLibSYS | OK OK OK | - | Conditional test and using to SSL, for md5(). |
| Special.SystemTests | OK OK OK (as a module) | ||
| Special.FLibMath | OK OK OK (as a module) | Performance tests. | |
| Special.FLibComplex1 | OK OK OK (as a module) | ||
In process of adaptation OpenSCADA to work on Android there was performed the significant approaches into the "autotool" based build environment OpenSCADA which can help further for adaption to work on other software platforms:
- Generic cleaning.
- Common adaption for static linking with the dependent libraries.
- The "pthread" library checking by a macro AX_PTHREAD but it's too different on the like kind software environments.
- Core libraries moved from direct pointing to checking, for: -lm, -ldl, -lcrypt, -lz, -lpcre. Which allow to pass libraries implemented into other system libraries and disable it at all in the correct way.
Qt5
Qt5 is cross-platform GUI toolkit and framework which historically used into OpenSCADA only as a GUI toolkit into Qt-based modules. Qt5 is a complex one and it has different problems on different versions and building options. For build examples of Qt5 next procedure was used.Followed table represents problems of different version of Qt5 represented on an example "icons":
| Version | Options | Problems |
| 5.7 | soft-float | Equal to versions 5.8 and 5.9 but have problems at installing where it tries install to "/var". |
| 5.8 | GCC 5 | Font is normal into bookmarks of the file dialog. May be it is generic problem into 5.7 5.8, (GCC 4.9), 5.9. |
| 5.7, 5.8, 5.9 | hard-float | All Qt icons miss or too small. |
| 5.9 | CrystaX NDK r10, GCC 5 | Build error by StdLib C++ some difference: |
Appending B. Extended performance tests on Asus Nexus7 II (Qualcomm Snapdragon APQ8064-1AA, Cortex-A15, 1.5 GHz, 4 Cores)
| Test | Operation sin(Pi), us | , into JavaLikeCalc | Operation pow(Pi,2), us | , into JavaLikeCalc | liboscada.so, MiB |
| armv5te, Soft, VFP2 | 0.9 | 1.58 | 0.15 | 0.88 | 13.79 |
| armv5te, Soft, NEON | 0.87 | 1.65 | 0.14 | 0.95 | 13.79 |
| armv5te, Soft, NEON, Thumb | 0.88 | 1.5 | 0.14 | 0.9 | 13 |
| armv7-a, Soft, VFP | 0.161 | 0.803 | 0.126 | 0.838 | 5.9 |
| armv7-a, Hard, VFP2 | 0.162 | 0.776 | 0.138 | 0.844 | 13.85 |
| armv7-a, Hard, NEON | 0.168 | 0.793 | 0.123 | 0.854 | 13.85 |
| armv7-a, Hard, NEON, Thumb | 0.17 | 0.85 | 0.15 | 0.87 | 12.82 |
Appending A. List of the generic progress of the task
+ purchase a modern internet tablet with Android;
+ read a book about Android NDK, using of Android NDK and Crystalx-NDK;
+ compiling for tests, education and execution;
+ initially (minimum) build and execute OpenSCADA for console (without GUI): PCRE, OpenSCADA Core, builtin modules: Transport.Sockets, Protocol.SelfSystem, DAQ.JavaLikeCalc, Special.FLibMath;
+ make the performance tests for Soft and Hard float;
+ compile for all OpenSCADA key modules to include/builtin them into the core;
+ compile for needed external libraries: OpenSSL, SQLite, GD [expat,libpng,jpeg,fontconfig,freetype], intl, iconv;
+ rebuild all already built parts into the original Ndk (outward the standalone one);
+ build Qt5: in the default configuration, with the early built libraries;
+ initial build OpenSCADA with Qt5;
+ build and observe an example of Qt5 as a Java package (APK);
+ adapt OpenSCADA to Qt5 on Android and build as a Java package (APK); get the program's locale from Java environment and set it to environment LANG;
+ the Java package (APK) resolve for different data files placing and fill in by: OpenSCADA icon and main images, configuration files, files of translation of the interface, files of DB and other of the libraries and models;
+ OpenSCADA main functions related to Qt restore and fix: Qt5 builds with soft-float but hard-float causes the mostly problems; two branches were created, based on CrystaX NDK r10 (from ABI 19) and Original Ndk r13 (from ABI 21); default interface style was set to "fusion";
- Some Android specific expandings of the project OpenSCADA:
+ read a book about Android NDK, using of Android NDK and Crystalx-NDK;
+ compiling for tests, education and execution;
+ initially (minimum) build and execute OpenSCADA for console (without GUI): PCRE, OpenSCADA Core, builtin modules: Transport.Sockets, Protocol.SelfSystem, DAQ.JavaLikeCalc, Special.FLibMath;
+ make the performance tests for Soft and Hard float;
+ compile for all OpenSCADA key modules to include/builtin them into the core;
+ compile for needed external libraries: OpenSSL, SQLite, GD [expat,libpng,jpeg,fontconfig,freetype], intl, iconv;
+ rebuild all already built parts into the original Ndk (outward the standalone one);
+ build Qt5: in the default configuration, with the early built libraries;
+ initial build OpenSCADA with Qt5;
+ build and observe an example of Qt5 as a Java package (APK);
+ adapt OpenSCADA to Qt5 on Android and build as a Java package (APK); get the program's locale from Java environment and set it to environment LANG;
+ the Java package (APK) resolve for different data files placing and fill in by: OpenSCADA icon and main images, configuration files, files of translation of the interface, files of DB and other of the libraries and models;
+ OpenSCADA main functions related to Qt restore and fix: Qt5 builds with soft-float but hard-float causes the mostly problems; two branches were created, based on CrystaX NDK r10 (from ABI 19) and Original Ndk r13 (from ABI 21); default interface style was set to "fusion";
- Some Android specific expandings of the project OpenSCADA:
- update Asus Nexux7 to Android 5 or more and check for the build on original NDKr13 and for ABI 21 and more.
- work out for possibility of deploy in separated packages: "core" (with all binaries, data and means for user's projects creation); "pre-installed" projects and models (with the project or model data and using all libraries and data from the "core" package);
- make some redesign for main page of UI.QTStarter but the tittle image is too small for big resolutions of screens;
- expand the module UI.QTStarter for the OpenSCADA projects management function;
- add for using QtWebView for last Qt5 and at QtWebKit miss.
- expand for the module DAQ.System by the Android sensors.