Failed to get Waydroid running with the orbstack kernel

[sharpoverride]

Hi,

I've been toying with this for a while now. But whenever I try to get waydroid running on any of

• Ubuntu Intel
• Fedora Intel

It comes back with Failed to load binder driver
modprobe: FATAL: Module binder_linux not found in directory /lib/modules/6.1.19-orbstack-00094-ga75ae6304f45
Binder node "binder" for waydroid not found

I tried cloning and compiling the orbstack kernel, but that also fails. Any way of getting the binder_linux module compiled?

I tried with dkms as per this guide https://github.com/choff/anbox-modules#install-instruction but still no luck. Beyond the obvious knowledge about compiling the kernel is there something specific on the orbstack kernel build that prevents me from getting waydroid running?

[kdrag0n]

I can enable Binder in a future version — that's not a problem. How are you planning to get graphics working though?

[sharpoverride]

Well.. I am currently installing xrdp on ubuntu and fedora :).. I haven't been able to get it running in Void linux.. but again I blame my lack of overall knowledge.

Any way I could enable binder in the kernel?

[kdrag0n]

Released in v0.6.0.

[kdrag0n]

Enabled for the next version.

[sharpoverride]

Thank you unfortunately waydroid says that /dev/binder has died :P oh well..

[kdrag0n]

Hmm, can you share the full output?

[sharpoverride]

on fedora arm is where I got to at least get this failure.. on x64 the contiainer doesn't even start
the logs write something like

(008666) [05:11:56] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(008666) [05:11:56] % modprobe -q ashmem_linux
(008666) [05:11:56] % chmod 666 -R /dev/binder
(008666) [05:11:56] % chmod 666 -R /dev/vndbinder
(008666) [05:11:56] % chmod 666 -R /dev/hwbinder
(008666) [05:12:14] % /usr/lib/waydroid/data/scripts/waydroid-net.sh start
vnic is waydroid0
FirewallD is not running
(008666) [05:12:14] % systemctl is-active -q nfcd
(008666) [05:12:14] % mv /var/lib/waydroid/config_session /var/lib/waydroid/lxc/waydroid
(008666) [05:12:14] % mount -o context="system_u:object_r:waydroid_rootfs_t:s0",ro /var/lib/waydroid/images/system.img /var/lib/waydroid/rootfs
(008666) [05:12:14] % mount -t overlay -o context="system_u:object_r:waydroid_rootfs_t:s0",ro,lowerdir=/var/lib/waydroid/overlay:/var/lib/waydroid/rootfs,upperdir=/var/lib/waydroid/overlay_rw/system,workdir=/var/lib/waydroid/overlay_work/system,xino=off overlay /var/lib/waydroid/rootfs
(008666) [05:12:14] % mount -o context="system_u:object_r:waydroid_rootfs_t:s0",ro /var/lib/waydroid/images/vendor.img /var/lib/waydroid/rootfs/vendor
(008666) [05:12:14] % mount -t overlay -o context="system_u:object_r:waydroid_rootfs_t:s0",ro,lowerdir=/var/lib/waydroid/overlay/vendor:/var/lib/waydroid/rootfs/vendor,upperdir=/var/lib/waydroid/overlay_rw/vendor,workdir=/var/lib/waydroid/overlay_work/vendor,xino=off overlay /var/lib/waydroid/rootfs/vendor
(008666) [05:12:14] % mount -o bind /var/lib/waydroid/waydroid.prop /var/lib/waydroid/rootfs/vendor/waydroid.prop
(008666) [05:12:14] Save config: /var/lib/waydroid/waydroid.cfg
(008666) [05:12:14] % lxc-start -P /var/lib/waydroid/lxc -F -n waydroid -- /init
(008666) [05:12:14] New background process: pid=9094, output=background
(008666) [05:12:14] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(008666) [05:12:14] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
RUNNING
(008666) [05:12:14] waiting 10 seconds for container to start...
lxc-start: waydroid: conf.c: run_buffer: 321 Script exited with status 126
lxc-start: waydroid: start.c: lxc_end: 988 Failed to run lxc.hook.post-stop for container "waydroid"
(009208) [05:12:36] % tail -n 60 -F /var/lib/waydroid/waydroid.log
(009208) [05:12:36] *** output passed to waydroid stdout, not to this log ***

the output when I try to waydroid session start is just [gbinder] WARNING Service manager /dev/binder has died

---

x64

[lazarmihai@fedora ~]$ waydroid log
(001108) [05:17:56] % mount -o bind /var/lib/waydroid/waydroid.prop /var/lib/waydroid/rootfs/vendor/waydroid.prop
(001108) [05:17:56] Save config: /var/lib/waydroid/waydroid.cfg
(001108) [05:17:56] % lxc-start -P /var/lib/waydroid/lxc -F -n waydroid -- /init
(001108) [05:17:56] New background process: pid=1240, output=background
(001108) [05:17:56] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
lxc-start: waydroid: seccomp.c: lxc_seccomp_load: 1256 Operation canceled - Error loading the seccomp policy
lxc-start: waydroid: sync.c: sync_wait: 34 An error occurred in another process (expected sequence number 4)
lxc-start: waydroid: start.c: __lxc_start: 2074 Failed to spawn container "waydroid"
STOPPED
(001108) [05:17:57] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:17:57] waiting 10 seconds for container to start...
lxc-start: waydroid: conf.c: run_buffer: 321 Script exited with status 126
lxc-start: waydroid: start.c: lxc_end: 988 Failed to run lxc.hook.post-stop for container "waydroid"
lxc-start: waydroid: tools/lxc_start.c: main: 306 The container failed to start
lxc-start: waydroid: tools/lxc_start.c: main: 311 Additional information can be obtained by setting the --logfile and --logpriority options
(001108) [05:17:58] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:17:58] waiting 9 seconds for container to start...
(001108) [05:17:59] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:17:59] waiting 8 seconds for container to start...
(001108) [05:18:00] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:00] waiting 7 seconds for container to start...
(001108) [05:18:01] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:01] waiting 6 seconds for container to start...
(001108) [05:18:02] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:02] waiting 5 seconds for container to start...
(001108) [05:18:03] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:03] waiting 4 seconds for container to start...
(001108) [05:18:04] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:04] waiting 3 seconds for container to start...
(001108) [05:18:05] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:05] waiting 2 seconds for container to start...
(001108) [05:18:06] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(001108) [05:18:06] waiting 1 seconds for container to start...
(001200) [05:18:07] org.freedesktop.DBus.Python.OSError: Traceback (most recent call last):
File "/usr/lib64/python3.11/site-packages/dbus/service.py", line 712, in _message_cb
retval = candidate_method(self, *args, **keywords)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/waydroid/tools/actions/container_manager.py", line 34, in Start
do_start(self.args, session)
File "/usr/lib/waydroid/tools/actions/container_manager.py", line 178, in do_start
helpers.lxc.start(args)
File "/usr/lib/waydroid/tools/helpers/lxc.py", line 397, in start
wait_for_running(args)
File "/usr/lib/waydroid/tools/helpers/lxc.py", line 391, in wait_for_running
raise OSError("container failed to start")
OSError: container failed to start

(001200) [05:18:07] OSError: container failed to start
(001300) [05:18:49] % tail -n 60 -F /var/lib/waydroid/waydroid.log
(001300) [05:18:49] *** output passed to waydroid stdout, not to this log ***

[0x5e]

thanks @kdrag0n , the binder part passed for me, the installation succeed, but I failed to start on waydroid session start:

xxx@ubuntu:~$ WAYLAND_DISPLAY="wayland-0" waydroid first-launch
[14:48:13] Starting waydroid session
[14:48:13] Wayland socket '/run/user/501/wayland-0' doesn't exist; are you running a Wayland compositor?

export WAYLAND_DISPLAY="wayland-0" doesn't help, wayland log have no useful info...

I'm using M1 Mac with orbstack + ubuntu latest.

I want to start an apk which runs a webserver background, so the gui is not need for me actually.

Any suggestions? Thanks in advance :)

[kdrag0n]

We're looking for an Android logcat here. LXC logs don't have any relevant info.

[0x5e]

> waydroid session start
[15:42:46] WAYLAND_DISPLAY is not set, defaulting to "wayland-0"
[gbinder] Service manager /dev/binder has appeared
[gbinder] WARNING: Service manager /dev/binder has died

> waydroid log
(000103) [15:40:11] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
STOPPED
(000103) [15:40:11] % /usr/lib/waydroid/data/scripts/waydroid-net.sh stop
vnic is waydroid0
(000103) [15:40:11] % systemctl is-enabled -q nfcd
Failed to get unit file state for nfcd.service: No such file or directory
(000103) [15:40:11] % umount /var/lib/waydroid/rootfs/vendor/waydroid.prop
(000103) [15:40:11] % umount /var/lib/waydroid/rootfs/vendor
(000103) [15:40:11] % umount /var/lib/waydroid/rootfs/vendor
(000103) [15:40:11] % umount /var/lib/waydroid/rootfs
(000103) [15:40:11] % umount /var/lib/waydroid/rootfs
(000363) [15:40:13] WAYLAND_DISPLAY is not set, defaulting to "wayland-0"
(000103) [15:40:13] % /usr/lib/waydroid/data/scripts/waydroid-net.sh start
vnic is waydroid0
(000103) [15:40:13] % systemctl is-active -q nfcd
(000103) [15:40:13] User-provided mount path is not owned by user: /run/user/501/pulse/native
(000103) [15:40:13] % mv /var/lib/waydroid/config_session /var/lib/waydroid/lxc/waydroid
(000103) [15:40:13] % mount -o ro /var/lib/waydroid/images/system.img /var/lib/waydroid/rootfs
(000103) [15:40:13] % mount -t overlay -o ro,lowerdir=/var/lib/waydroid/overlay:/var/lib/waydroid/rootfs,upperdir=/var/lib/waydroid/overlay_rw/system,workdir=/var/lib/waydroid/overlay_work/system,xino=off overlay /var/lib/waydroid/rootfs
(000103) [15:40:13] % mount -o ro /var/lib/waydroid/images/vendor.img /var/lib/waydroid/rootfs/vendor
(000103) [15:40:13] % mount -t overlay -o ro,lowerdir=/var/lib/waydroid/overlay/vendor:/var/lib/waydroid/rootfs/vendor,upperdir=/var/lib/waydroid/overlay_rw/vendor,workdir=/var/lib/waydroid/overlay_work/vendor,xino=off overlay /var/lib/waydroid/rootfs/vendor
(000103) [15:40:13] % mount -o bind /var/lib/waydroid/waydroid.prop /var/lib/waydroid/rootfs/vendor/waydroid.prop
(000103) [15:40:13] Save config: /var/lib/waydroid/waydroid.cfg
(000103) [15:40:13] % lxc-start -P /var/lib/waydroid/lxc -F -n waydroid -- /init
(000103) [15:40:13] New background process: pid=397, output=background
(000103) [15:40:13] % lxc-info -P /var/lib/waydroid/lxc -n waydroid -sH
RUNNING
lxc-start: waydroid: conf.c: run_buffer: 321 Script exited with status 126
lxc-start: waydroid: start.c: lxc_end: 988 Failed to run lxc.hook.post-stop for container "waydroid"
(000431) [15:40:27] % tail -n 60 -F /var/lib/waydroid/waydroid.log
(000431) [15:40:27] *** output passed to waydroid stdout, not to this log ***

> cat /proc/pressure/cpu
some avg10=0.00 avg60=0.00 avg300=0.00 total=626785
full avg10=0.00 avg60=0.00 avg300=0.00 total=0

> sudo waydroid logcat
[15:44:21] WayDroid container is STOPPED

> dmesg
...
[ 4132.161113] loop0: detected capacity change from 0 to 3395176
[ 4132.163126] EXT4-fs (loop0): mounted filesystem without journal. Quota mode: disabled.
[ 4132.166432] loop1: detected capacity change from 0 to 593384
[ 4132.167330] EXT4-fs (loop1): mounted filesystem without journal. Quota mode: disabled.
[ 4132.277133] waydroid0: port 1(vethNGvBqW) entered blocking state
[ 4132.277136] waydroid0: port 1(vethNGvBqW) entered disabled state
[ 4132.277153] device vethNGvBqW entered promiscuous mode
[ 4132.277287] waydroid0: port 1(vethNGvBqW) entered blocking state
[ 4132.277288] waydroid0: port 1(vethNGvBqW) entered forwarding state
[ 4132.277565] waydroid0: port 1(vethNGvBqW) entered disabled state
[ 4132.278844] eth0: renamed from vethjlv92B
[ 4132.315621] IPv6: ADDRCONF(NETDEV_CHANGE): vethNGvBqW: link becomes ready
[ 4132.315639] waydroid0: port 1(vethNGvBqW) entered blocking state
[ 4132.315640] waydroid0: port 1(vethNGvBqW) entered forwarding state
[ 4132.315660] IPv6: ADDRCONF(NETDEV_CHANGE): waydroid0: link becomes ready
[ 4132.318930] binder: 1773:1072 cannot find target node
[ 4132.318933] binder: 1072:1773 transaction call to 0:0 failed 8291/29189/-22, size 0-0 line 3030
[ 4132.319186] binder: 1774:1730 cannot find target node
[ 4132.319187] binder: 1730:1774 transaction call to 0:0 failed 8292/29189/-22, size 0-0 line 3030
[ 4132.332740] init: init first stage started!
[ 4132.332773] init: Unable to open /lib/modules, skipping module loading.
[ 4132.332784] init: Skipped setting INIT_AVB_VERSION (not in recovery mode)
[ 4132.338789] init: init second stage started!
[ 4132.342759] init: Using Android DT directory /proc/device-tree/firmware/android/
[ 4132.342988] init: Couldn't load property file '/vendor_extra/build.prop': open() failed: No such file or directory: No such file or directory
[ 4132.343397] init: Couldn't load property file '/factory/factory.prop': open() failed: No such file or directory: No such file or directory
[ 4132.343680] init: Setting product property ro.product.brand to 'waydroid' (from ro.product.product.brand)
[ 4132.343690] init: Setting product property ro.product.device to 'waydroid_arm64' (from ro.product.product.device)
[ 4132.343700] init: Setting product property ro.product.manufacturer to 'Waydroid' (from ro.product.product.manufacturer)
[ 4132.343710] init: Setting product property ro.product.model to 'WayDroid arm64 Device' (from ro.product.product.model)
[ 4132.343720] init: Setting product property ro.product.name to 'lineage_waydroid_arm64' (from ro.product.product.name)
[ 4132.343732] init: Setting property 'ro.build.fingerprint' to 'waydroid/lineage_waydroid_arm64/waydroid_arm64:11/RQ3A.211001.001/32:userdebug/test-keys'
[ 4132.351727] cgroup: Unknown subsys name 'schedtune'
[ 4132.363648] ueventd: ueventd started!
[ 4132.364038] selinux: SELinux: Loaded file_contexts
[ 4132.364039] selinux:
[ 4132.364058] ueventd: Parsing file /system/etc/ueventd.rc...
[ 4132.364153] ueventd: Parsing file /vendor/ueventd.rc...
[ 4132.364184] ueventd: Unable to read config file '/vendor/ueventd.rc': open() failed: No such file or directory
[ 4132.364190] ueventd: Parsing file /odm/ueventd.rc...
[ 4132.364194] ueventd: Unable to read config file '/odm/ueventd.rc': open() failed: No such file or directory
[ 4132.364201] ueventd: Parsing file /ueventd.unknown.rc...
[ 4132.364206] ueventd: Unable to read config file '/ueventd.unknown.rc': open() failed: No such file or directory
[ 4132.365188] apexd: This device does not support updatable APEX. Exiting
[ 4132.373871] binder: 1788:1788 cannot find target node
[ 4132.373873] binder: 1788:1788 transaction call to 0:0 failed 8293/29189/-22, size 0-0 line 3030
[ 4132.375988] binder: 1794:1794 cannot find target node
[ 4132.375990] binder: 1794:1794 transaction call to 0:0 failed 8294/29189/-22, size 0-0 line 3030
[ 4132.376015] ProcessState: Not able to get context object on /dev/binder.
[ 4132.376017] ServiceManager: Waiting 1s on context object on /dev/binder.
[ 4132.385501] binder: 1791:1791 cannot find target node
[ 4132.385503] binder: 1791:1791 transaction call to 0:0 failed 8296/29189/-22, size 0-0 line 3030
[ 4133.390111] vdc: Waited 10ms for vold
[ 4133.398059] vdc: Waited 0ms for vold
[ 4133.418383] apexd: This device does not support updatable APEX. Exiting
[ 4133.539753] printk: ueventd: 2 output lines suppressed due to ratelimiting
[ 4133.540036] printk: init: 292 output lines suppressed due to ratelimiting
[ 4133.541680] waydroid0: port 1(vethNGvBqW) entered disabled state
[ 4133.541983] device vethNGvBqW left promiscuous mode
[ 4133.541985] waydroid0: port 1(vethNGvBqW) entered disabled state
[ 4133.562234] binder: 1775 RLIMIT_NICE not set
[ 4133.562328] binder: 1775 RLIMIT_NICE not set
[ 4133.562376] binder: 1730:1774 BC_DEAD_BINDER_DONE 0000000000000000 not found
[ 4133.562403] binder: 1072:1072 BC_DEAD_BINDER_DONE 0000000000000000 not found
[ 4138.097311] binder_debug: 32 callbacks suppressed
[ 4138.097328] binder: 1774:1730 cannot find target node
[ 4138.097339] binder: 1730:1774 transaction call to 0:0 failed 8380/29189/-22, size 0-0 line 3030
[ 4139.100007] binder: 1774:1730 cannot find target node
[ 4139.100041] binder: 1730:1774 transaction call to 0:0 failed 8382/29189/-22, size 0-0 line 3030
[ 4139.100862] binder: 1072:1072 cannot find target node
[ 4139.100869] binder: 1072:1072 transaction call to 0:0 failed 8383/29189/-22, size 0-0 line 3030

here are logs after using PSI enabled kernel. I guess PSI can be confirmed by cat /proc/pressure/cpu but waydroid still says "binder has died" :(
waydroid logcat tells nothing, dmesg is it useful ?

Update:
I compared two start between new and old kernel,dmesg output are the same.

[0x5e]

How can I confirm binder is enabled? lsmod returns empty and modprobe binder_linux get failed with modprobe: FATAL: Module binder_linux not found in directory /lib/modules/6.1.27-orbstack-00157-ge13e9ffcc54a

from this commit: waydroid/waydroid@20d3c5e
I see the string of /dev/binderfs/binder-control, it doesn't exist too, not sure if it's expected behavior.

[kdrag0n]

ls /dev/*binder

That log suggests that it's probably caused by a lack of SELinux support. SELinux doesn't support namespacing which is more or less required for us to make it work, so I wouldn't expect it to be fixed any time soon unfortunately.

We're currently only supporting preset Binder nodes so it's normal that binderfs doesn't exist.

[0x5e]

OK, thanks anyway :)