realm
realm copied to clipboard
Improve test data
Is your feature request related to a problem? Please describe. Currently the test data is unrealistic. We'd like to have more realistic data so we can use it for demos and UI testing. Currently the data doesn't demo super well and would be great to be able to use this to walk people through the platform.
I'd also like to see the number of tasks in quests reduced to be more realistic. We can have a separate set of data of 900 tasks to test UI performance but would like that to be a separate set of data.
Some reach asks:
- command output, hostnames, and platform match such that linux command output and hostnames belong to the Linux platform host.
- Creator information: some tasks created by "me" id:
30064771073
and some creators with PFPs and names.
Describe the solution you'd like Improve test data by:
- Adding a mix of MacOS, Linux, and Windows platforms
- Adding realistic comand output (see Appendix A)
- Hostnames are just SERVICE-GROUP we should use some realistic hostnames:
- DESKTOP-UU1KCDG
- DESKTOP-V1XZZQ3
- Can we auto generate the Windows names?
- bobs-macbook-pro.local
- Chris-mbp
- ubuntu
- 10b4e61b309f
- [Can we auto generate docker like hostnames?]
- varied quest states - currently only have one quest with some output
- "Queued" - Some quests that have no output, no last modified, no exec finished
- "In progress" - Some questst that have output, a last modified, no exec finished
- "Finished" - Some quests that have output, a last modified, and exec finished.
- "Finished no output" - Some quests that dont have output, do have a last modified and exec finished.
- **Currently only one quest "helloworld" has tasks with output available and 5 quests with 900 tasks with output 'hello' **
Apendix A
ls -lah ./ - linux
total 60K
drwxr-xr-x 1 root root 4.0K Dec 9 23:03 .
drwxr-xr-x 1 root root 4.0K Dec 9 23:03 ..
-rwxr-xr-x 1 root root 0 Dec 9 23:03 .dockerenv
lrwxrwxrwx 1 root root 7 Nov 28 06:56 bin -> usr/bin
drwxr-xr-x 2 root root 4.0K Apr 18 2022 boot
drwxr-xr-x 5 root root 340 Dec 9 23:03 dev
drwxr-xr-x 1 root root 4.0K Dec 9 23:03 etc
drwxr-xr-x 2 root root 4.0K Apr 18 2022 home
lrwxrwxrwx 1 root root 7 Nov 28 06:56 lib -> usr/lib
lrwxrwxrwx 1 root root 9 Nov 28 06:56 lib32 -> usr/lib32
lrwxrwxrwx 1 root root 9 Nov 28 06:56 lib64 -> usr/lib64
lrwxrwxrwx 1 root root 10 Nov 28 06:56 libx32 -> usr/libx32
drwxr-xr-x 2 root root 4.0K Nov 28 06:56 media
drwxr-xr-x 2 root root 4.0K Nov 28 06:56 mnt
drwxr-xr-x 2 root root 4.0K Nov 28 06:56 opt
dr-xr-xr-x 152 root root 0 Dec 9 23:03 proc
drwx------ 2 root root 4.0K Nov 28 06:59 root
drwxr-xr-x 5 root root 4.0K Nov 28 06:59 run
lrwxrwxrwx 1 root root 8 Nov 28 06:56 sbin -> usr/sbin
drwxr-xr-x 2 root root 4.0K Nov 28 06:56 srv
dr-xr-xr-x 13 root root 0 Dec 9 23:03 sys
drwxrwxrwt 1 root root 4.0K Dec 9 23:05 tmp
drwxr-xr-x 14 root root 4.0K Nov 28 06:56 usr
drwxr-xr-x 1 root root 4.0K Nov 28 06:59 var
ps -faux - linux
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 2 0.0 0.0 0 0 ? S 02:41 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [rcu_gp]
root 4 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [rcu_par_gp]
root 5 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [netns]
root 7 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kworker/0:0H-events_highpri]
root 9 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kworker/0:1H-events_highpri]
root 10 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [mm_percpu_wq]
root 11 0.0 0.0 0 0 ? S 02:41 0:00 \_ [rcu_tasks_rude_]
root 12 0.0 0.0 0 0 ? S 02:41 0:00 \_ [rcu_tasks_trace]
root 13 0.0 0.0 0 0 ? S 02:41 0:01 \_ [ksoftirqd/0]
root 14 0.0 0.0 0 0 ? I 02:41 0:04 \_ [rcu_sched]
root 15 0.0 0.0 0 0 ? S 02:41 0:00 \_ [migration/0]
root 16 0.0 0.0 0 0 ? S 02:41 0:00 \_ [idle_inject/0]
root 18 0.0 0.0 0 0 ? S 02:41 0:00 \_ [cpuhp/0]
root 19 0.0 0.0 0 0 ? S 02:41 0:00 \_ [cpuhp/1]
root 20 0.0 0.0 0 0 ? S 02:41 0:00 \_ [idle_inject/1]
root 21 0.0 0.0 0 0 ? S 02:41 0:00 \_ [migration/1]
root 22 0.0 0.0 0 0 ? S 02:41 0:01 \_ [ksoftirqd/1]
root 24 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kworker/1:0H-events_highpri]
root 25 0.0 0.0 0 0 ? S 02:41 0:00 \_ [kdevtmpfs]
root 26 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [inet_frag_wq]
root 27 0.0 0.0 0 0 ? S 02:41 0:00 \_ [kauditd]
root 29 0.0 0.0 0 0 ? S 02:41 0:00 \_ [khungtaskd]
root 30 0.0 0.0 0 0 ? S 02:41 0:00 \_ [oom_reaper]
root 31 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [writeback]
root 32 0.0 0.0 0 0 ? S 02:41 0:04 \_ [kcompactd0]
root 33 0.0 0.0 0 0 ? SN 02:41 0:00 \_ [ksmd]
root 34 0.0 0.0 0 0 ? SN 02:41 0:00 \_ [khugepaged]
root 80 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kintegrityd]
root 81 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kblockd]
root 82 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [blkcg_punt_bio]
root 83 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [tpm_dev_wq]
root 84 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [ata_sff]
root 85 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [md]
root 86 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [edac-poller]
root 87 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [devfreq_wq]
root 88 0.0 0.0 0 0 ? S 02:41 0:00 \_ [watchdogd]
root 90 0.0 0.0 0 0 ? I< 02:41 0:03 \_ [kworker/1:1H-events_highpri]
root 92 0.0 0.0 0 0 ? S 02:41 0:02 \_ [kswapd0]
root 93 0.0 0.0 0 0 ? S 02:41 0:00 \_ [ecryptfs-kthrea]
root 95 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kthrotld]
root 96 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [acpi_thermal_pm]
root 97 0.0 0.0 0 0 ? S 02:41 0:00 \_ [scsi_eh_0]
root 98 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [scsi_tmf_0]
root 99 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [nvme-wq]
root 100 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [nvme-reset-wq]
root 101 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [nvme-delete-wq]
root 102 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [vfio-irqfd-clea]
root 105 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [mld]
root 106 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [ipv6_addrconf]
root 116 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kstrp]
root 119 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [zswap-shrink]
root 120 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kworker/u5:0]
root 127 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [charger_manager]
root 128 0.0 0.0 0 0 ? S 02:41 0:02 \_ [jbd2/sda1-8]
root 129 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [ext4-rsv-conver]
root 132 0.0 0.0 0 0 ? S 02:41 0:00 \_ [hwrng]
root 205 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kaluad]
root 207 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kmpath_rdacd]
root 209 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kmpathd]
root 210 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [kmpath_handlerd]
root 249 0.0 0.0 0 0 ? I< 02:41 0:00 \_ [cryptd]
root 66641 0.0 0.0 0 0 ? I 16:31 0:00 \_ [kworker/1:1-events]
root 68936 0.0 0.0 0 0 ? I 20:29 0:00 \_ [kworker/u4:1-flush-8:0]
root 69006 0.0 0.0 0 0 ? I 20:42 0:00 \_ [kworker/0:0-events]
root 69007 0.0 0.0 0 0 ? I 20:42 0:00 \_ [kworker/0:3-cgroup_destroy]
root 69818 0.0 0.0 0 0 ? I 22:33 0:00 \_ [kworker/1:0-events]
root 70156 0.0 0.0 0 0 ? I 22:54 0:00 \_ [kworker/u4:0-events_unbound]
root 70209 0.0 0.0 0 0 ? I 23:00 0:00 \_ [kworker/u4:2-events_power_efficient]
root 70240 0.0 0.0 0 0 ? I 23:05 0:00 \_ [kworker/u4:3]
root 70265 0.0 0.0 0 0 ? I 23:09 0:00 \_ [kworker/0:1-events]
root 1 0.0 0.3 102160 13368 ? Ss 02:41 0:46 /lib/systemd/systemd --system --deserialize 41
message+ 574 0.0 0.1 8888 4880 ? Ss 02:42 0:04 @dbus-daemon --system --address=systemd: --nofork --nopidfil
root 592 0.0 0.4 33128 16188 ? Ss 02:42 0:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-
root 795 0.0 0.4 110204 16616 ? Ssl 02:42 0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-u
root 825 0.0 0.1 235520 7908 ? Ssl 02:42 0:00 /usr/libexec/polkitd --no-debug
root 831 0.0 0.0 6216 876 ttyS0 Ss+ 02:42 0:00 /sbin/agetty -o -p -- \u --keep-baud 115200,57600,38400,9600
root 834 0.0 0.0 6172 908 tty1 Ss+ 02:42 0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
_chrony 1509 0.0 0.0 18916 2864 ? S 02:42 0:00 /usr/sbin/chronyd -F 1
_chrony 1510 0.0 0.0 10588 524 ? S 02:42 0:00 \_ /usr/sbin/chronyd -F 1
uuidd 1932 0.0 0.0 9616 1088 ? Ss 02:42 0:00 /usr/sbin/uuidd --socket-activation
root 2413 0.0 0.3 295936 13440 ? Ssl 02:42 0:00 /usr/libexec/packagekitd
root 3377 0.0 2.9 2359044 117760 ? Ssl 02:43 0:15 /usr/local/bin/sliver-server daemon
root 44478 0.0 0.7 1467084 30892 ? Ssl 06:31 0:25 /usr/lib/snapd/snapd
root 45633 0.0 0.5 1238540 20416 ? Ssl 06:32 0:07 /usr/bin/google_osconfig_agent
systemd+ 46123 0.0 0.2 16244 8580 ? Ss 06:32 0:00 /lib/systemd/systemd-networkd
root 46131 0.0 0.3 1379096 14140 ? Ssl 06:32 0:09 /usr/bin/google_guest_agent
root 46236 0.0 0.3 55908 15364 ? S<s 06:32 0:03 /lib/systemd/systemd-journald
root 46332 0.0 0.1 15336 7628 ? Ss 06:32 0:00 /lib/systemd/systemd-logind
root 46339 0.0 0.0 7284 2704 ? Ss 06:32 0:00 /usr/sbin/cron -f -P
root 48041 0.0 0.2 15424 9520 ? Ss 06:34 0:02 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
root 70261 0.2 0.2 16912 10888 ? Ss 23:09 0:00 \_ sshd: sysadmin [priv]
sysadmin 70348 0.0 0.1 17208 8016 ? S 23:09 0:00 \_ sshd: sysadmin@pts/0
sysadmin 70349 1.5 0.1 9148 5304 pts/0 Ss 23:09 0:00 \_ -bash
sysadmin 70359 0.0 0.0 10888 3576 pts/0 R+ 23:09 0:00 \_ ps -faux
root 48364 0.0 0.1 11084 5884 ? Ss 06:34 0:00 /lib/systemd/systemd-udevd
root 56172 0.0 0.6 223812 27100 ? SLsl 06:38 0:10 /sbin/multipathd -d -s
syslog 57777 0.0 0.1 222400 4120 ? Ssl 06:40 0:00 /usr/sbin/rsyslogd -n -iNONE
sysadmin 70264 2.0 0.2 17088 9848 ? Ss 23:09 0:00 /lib/systemd/systemd --user
sysadmin 70266 0.0 0.1 105072 5108 ? S 23:09 0:00 \_ (sd-pam)
ifconfig - macosx
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384
options=1203<RXCSUM,TXCSUM,TXSTATUS,SW_TIMESTAMP>
inet 127.0.0.1 netmask 0xff000000
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
nd6 options=201<PERFORMNUD,DAD>
gif0: flags=8010<POINTOPOINT,MULTICAST> mtu 1280
stf0: flags=0<> mtu 1280
en22: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
ether ac:de:48:00:11:22
inet6 fe80::aede:48ff:fe00:1122%en22 prefixlen 64 scopeid 0x4
nd6 options=201<PERFORMNUD,DAD>
media: autoselect (100baseTX <full-duplex>)
status: active
ap1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
options=400<CHANNEL_IO>
ether aa:66:5a:2e:b6:9d
media: autoselect
en0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=6463<RXCSUM,TXCSUM,TSO4,TSO6,CHANNEL_IO,PARTIAL_CSUM,ZEROINVERT_CSUM>
ether 88:66:5a:2e:b6:9d
inet6 fe80::141d:8bb6:cb98:e39f%en0 prefixlen 64 secured scopeid 0x6
inet 10.10.0.141 netmask 0xffffff00 broadcast 10.10.0.255
nd6 options=201<PERFORMNUD,DAD>
media: autoselect
status: active
awdl0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=6463<RXCSUM,TXCSUM,TSO4,TSO6,CHANNEL_IO,PARTIAL_CSUM,ZEROINVERT_CSUM>
ether e2:0c:9a:4f:d2:ae
inet6 fe80::e00c:9aff:fe4f:d2ae%awdl0 prefixlen 64 scopeid 0x7
nd6 options=201<PERFORMNUD,DAD>
media: autoselect
status: active
llw0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=400<CHANNEL_IO>
ether e2:0c:9a:4f:d2:ae
inet6 fe80::e00c:9aff:fe4f:d2ae%llw0 prefixlen 64 scopeid 0x8
nd6 options=201<PERFORMNUD,DAD>
media: autoselect
status: inactive
en4: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
options=460<TSO4,TSO6,CHANNEL_IO>
ether 82:33:68:21:a4:04
media: autoselect <full-duplex>
status: inactive
en1: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
options=460<TSO4,TSO6,CHANNEL_IO>
ether 82:33:68:21:a4:01
media: autoselect <full-duplex>
status: inactive
en2: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
options=460<TSO4,TSO6,CHANNEL_IO>
ether 82:33:68:21:a4:00
media: autoselect <full-duplex>
status: inactive
en3: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
options=460<TSO4,TSO6,CHANNEL_IO>
ether 82:33:68:21:a4:05
media: autoselect <full-duplex>
status: inactive
bridge0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=63<RXCSUM,TXCSUM,TSO4,TSO6>
ether 82:33:68:21:a4:01
Configuration:
id 0:0:0:0:0:0 priority 0 hellotime 0 fwddelay 0
maxage 0 holdcnt 0 proto stp maxaddr 100 timeout 1200
root id 0:0:0:0:0:0 priority 0 ifcost 0 port 0
ipfilter disabled flags 0x0
member: en1 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 10 priority 0 path cost 0
member: en2 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 11 priority 0 path cost 0
member: en3 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 12 priority 0 path cost 0
member: en4 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 9 priority 0 path cost 0
nd6 options=201<PERFORMNUD,DAD>
media: <unknown type>
status: inactive
utun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1380
inet6 fe80::cad3:81af:93:7ec%utun0 prefixlen 64 scopeid 0xf
nd6 options=201<PERFORMNUD,DAD>
utun1: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 2000
inet6 fe80::c093:8969:1e5e:cde5%utun1 prefixlen 64 scopeid 0x10
nd6 options=201<PERFORMNUD,DAD>
utun2: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1000
inet6 fe80::ce81:b1c:bd2c:69e%utun2 prefixlen 64 scopeid 0x11
nd6 options=201<PERFORMNUD,DAD>
utun3: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1380
inet6 fe80::fe43:d186:e266:cfe5%utun3 prefixlen 64 scopeid 0x17
nd6 options=201<PERFORMNUD,DAD>
utun4: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1380
inet6 fe80::a4fc:1e97:7abc:f1%utun4 prefixlen 64 scopeid 0x18
nd6 options=201<PERFORMNUD,DAD>
utun5: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1380
inet6 fe80::4bc6:1a5:b3a0:a70e%utun5 prefixlen 64 scopeid 0x19
nd6 options=201<PERFORMNUD,DAD>
utun6: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1380
inet6 fe80::931:c4aa:5b42:e0f7%utun6 prefixlen 64 scopeid 0x1a
nd6 options=201<PERFORMNUD,DAD>
vmenet0: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
ether 1e:74:aa:49:2f:bf
media: autoselect
status: active
bridge100: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=3<RXCSUM,TXCSUM>
ether 8a:66:5a:e2:f6:64
inet 192.168.253.1 netmask 0xffffff00 broadcast 192.168.253.255
inet6 fe80::8866:5aff:fee2:f664%bridge100 prefixlen 64 scopeid 0x13
Configuration:
id 0:0:0:0:0:0 priority 0 hellotime 0 fwddelay 0
maxage 0 holdcnt 0 proto stp maxaddr 100 timeout 1200
root id 0:0:0:0:0:0 priority 0 ifcost 0 port 0
ipfilter disabled flags 0x0
member: vmenet0 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 18 priority 0 path cost 0
nd6 options=201<PERFORMNUD,DAD>
media: autoselect
status: active
vmenet1: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
ether fa:1f:d7:c7:cd:cb
media: autoselect
status: active
bridge101: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500
options=3<RXCSUM,TXCSUM>
ether 8a:66:5a:e2:f6:65
inet 192.168.119.1 netmask 0xffffff00 broadcast 192.168.119.255
inet6 fe80::8866:5aff:fee2:f665%bridge101 prefixlen 64 scopeid 0x15
Configuration:
id 0:0:0:0:0:0 priority 0 hellotime 0 fwddelay 0
maxage 0 holdcnt 0 proto stp maxaddr 100 timeout 1200
root id 0:0:0:0:0:0 priority 0 ifcost 0 port 0
ipfilter disabled flags 0x0
member: vmenet1 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 20 priority 0 path cost 0
member: vmenet2 flags=3<LEARNING,DISCOVER>
ifmaxaddr 0 port 22 priority 0 path cost 0
nd6 options=201<PERFORMNUD,DAD>
media: autoselect
status: active
vmenet2: flags=8963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
ether 92:15:8c:c7:9a:31
media: autoselect
status: active
utun7: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1426
inet 10.23.12.8 --> 10.23.12.8 netmask 0xffffff00
Describe alternatives you've considered
- Mocking data in the front end.
- This won't allow us to test the queries that the front end performs.
- Testing the queries is good for functionality testing & performance tests.
Additional context
Kyle: "Yes I would like a sql dump of test data and I will just make it that. So if you’d like to provide SQL of what it should be I can include it"