2022-03-01 14:29:18 tomalok: btw $dayjob people are curious about tiny-cloud 2022-03-01 14:33:45 we are looking for something like CoreOS ignition 2022-03-01 15:01:48 Ariadne: I guess CoreOS's previous coreos-cloudinit would have been more what you'd be interested in (this was their predecessor to ignition) for cloud-init compatibility 2022-03-01 15:02:12 we just want to be able to run some commands on an alpine image at first boot 2022-03-01 15:02:36 i dont think we explicitly care about cloud-init compatibility 2022-03-01 15:43:23 Ariadne: there anything that tiny-cloud needs featurewise for your $dayjob people? 2022-03-01 15:43:47 not sure yet, i can make said people come bother you directly :P 2022-03-01 15:44:12 feature requests in issues ;) 2022-03-01 15:49:13 fwiw i did get tiny-cloud (and cloudinit) working on OCI from a alpine-cloud-images built qcow2 image this weekend -- just need to write the module for importing and publishing (and figure out the best way to do that with OCI's iam policy, probably have a "published" compartment with a policy that allows any tenancy to use the images in it. 2022-03-01 15:49:41 the 1 GiB images result in just under 50 GiB root (apparently that 2022-03-01 15:49:55 's the minimum boot volume size) 2022-03-01 15:50:36 speaking of $dayjob, it's probably time i context-switch. 2022-03-01 16:11:34 this isn't about OCI, but about the host environment :D 2022-03-01 19:25:02 yep, just an informal progress report on other clouds 2022-03-04 16:39:16 ohhh 2022-03-04 17:05:32 Slightly off-topic: https://www.reddit.com/r/googlecloud/comments/t5jp48/comment/hz9k2t3/?utm_source=share&utm_medium=web2x&context=3 2022-03-04 17:08:23 No UTM: https://www.reddit.com/r/googlecloud/comments/t5jp48/comment/hz9k2t3 2022-03-04 17:14:12 ikke: sorry, forgot to remove them 2022-03-04 17:14:16 np 2022-03-04 17:14:45 need to find a browser extension to do that for me 2022-03-04 17:14:57 There was some clean url extension 2022-03-04 17:15:19 LOL 2022-03-04 17:15:43 The extension page for CleanURLs has utm params itself :D 2022-03-04 17:15:49 https://addons.mozilla.org/en-US/firefox/addon/clearurls 2022-03-04 17:16:00 lol, you couldn't make it up 2022-03-04 17:16:42 Obviously outside of the contorl of the extension author 2022-03-04 17:16:46 control* 2022-03-05 01:29:13 i have wanted an extension like that for a while 2022-03-05 01:29:14 thanks 2022-03-05 03:33:36 psykose: missing some context -- i didn't realize i lost my connection until just before your reply... ;P 2022-03-05 03:33:54 it was a random firefox extension :) 2022-03-05 03:34:04 https://addons.mozilla.org/en-US/firefox/addon/clearurls 2022-03-05 03:34:06 quite offtopic :p 2022-03-05 03:34:16 ah, okay :) 2022-03-05 03:44:41 though the original post wasn't as offtopic - Google Cloud laying off their USA support team... 2022-03-05 07:42:55 tomalok: haha earlier i thought you were talking about OCI containers 2022-03-05 07:43:02 instead of Oracle Cloud Infrastructure 2022-03-05 07:45:14 o_o 2022-03-05 20:32:32 ariadne: overloaded acronyms... ;) 2022-03-05 20:34:32 TNSTATMA - there's no such thing as too many acronyms ;-) 2022-03-14 23:11:00 tomalok: have you used tiny-cloud on azure? 2022-03-14 23:29:40 i've tested the imds script itself, but haven't created an image to test the whole thing just yet. i've done that testing on OCI and it works there. 2022-03-14 23:34:10 tomalok: BTW meant to ask your thoughts about mkinitfs feature files for various clouds - in my own scripts I'm creating cloud-aws.modules, cloud-azure.modules, etc rather than trying to manipulate the contents of virtio.modules. 2022-03-14 23:34:46 and likewise for VMs I'm creating vm-virtualbox.modules, vm-qemu.modules, etc 2022-03-14 23:35:35 minimal: haven't had a chance to do any compare/contrast between what we set up for AWS vs. other clouds, i do know there will be some differences 2022-03-14 23:37:38 yes, for networking "ena" vs "mana" vs "gve", azure doesn't use virtio in general, it has its own set of specific modules for storage, network, etc 2022-03-14 23:38:31 that's why I wondered whether we should try and standardise these and get them into the mkinitfs package 2022-03-14 23:45:12 maybe? it should be possible for alpine-cloud-images custom configs to +/- kernel_modules, kernel_options, and initfs_features in any case 2022-03-14 23:46:32 anything in mkinitfs that helps orchestrate that would be nice -- i think right now there's some sed magic behind the scenes to explicitly add/remove those bits 2022-03-14 23:46:42 well I was suggesting deduplicating the work of you, me, and anyone else creating VM and Cloud images 2022-03-14 23:47:26 the current virtio.modules file is a mess and it contains (from memory) both host hypervisor machine vhost modules and also VM machine "client" virtio modules 2022-03-14 23:52:33 yeah, VMs don't really need the VH stuff 2022-03-14 23:53:32 it makes more sense to have a vmhost.modules file (for hypervisors) and then multiple vm-hypervisor-specific and cloud-specific modules files 2022-03-14 23:53:44 which it basically what I've being doing for my own stuff 2022-03-14 23:54:46 as then, for example, depending on the type of console (normal/serial/hvc) supported by a hypervisor/cloud provider you can drop the relevant module(s) in their file 2022-03-14 23:58:04 basically to boot on any VM/Cloud you only really need the drm module, input/console module, storage module, and possibly network module (most other stuff doesn't need to be initramfs, it can be loaded once rootfs is mounted/booted) 2022-03-14 23:58:47 well that's on top of the standard initramfs stuff like fs module etc 2022-03-15 00:05:00 (nod) some/most clouds also have bare metal "instances" these days, so we'll need to be able to make some adjustments for those too 2022-03-15 01:17:16 tomalok: i tried it and i got an error from ifupdown-ng, maybe i am holding it wrong. 2022-03-15 01:18:16 https://tpaste.us/yvkp 2022-03-15 01:49:44 clandmeter what's in your /etc/network/interfaces file? 2022-03-15 07:49:09 tomalok: i have no clue, i cannot access the vm 2022-03-16 20:47:18 ncopa: looks like there are some new cloud images to build? anything older than 3.15 going to be bumped any time soon, or is 3.15.1 all there is at the moment? 2022-03-16 20:47:49 I just tagged 3.15.1 2022-03-16 20:48:31 3.15.1 is all there is atm. I will probably do new 3.14, 3.13 and 3.12 releases tomorrow 2022-03-16 20:49:23 would be ok to build the cloud images tomorrow, then? one batch instead of two? 2022-03-17 08:01:22 sure 2022-03-17 09:58:43 tomalok: the 3.12.10, 3.13.8 and 3.14.4 releases are out now 2022-03-18 01:15:25 something seems to have broken with the aarch64 uefi firmware... looking into what might have changed? x86_64 uefi firmware is working though 2022-03-18 01:24:48 tomalok: there is a *proposed* MR to make changes to the edk2 package (which builds x86/x86_64/aarch64 UEFI firmware) but it has noy been merged yet. So nothing should have changed. 2022-03-18 01:25:08 There was a minor general packaging change 1 month ago: https://git.alpinelinux.org/aports/log/community/edk2/APKBUILD 2022-03-18 01:32:45 i seem to have gotten around it with 'truncate -s 67108864 QEMU_EFI.fd' -- qemu complaining that the image was too small -- might be a qemu-system-aarch64 change 2022-03-18 01:52:50 I've never actually tried the Alpine aarch64 UEFI files yet (partly because I'm running VMs on a Debian box and partly as the aarch64 UEFI files are only packaged for aarch64 - that's what the in-progress MR someone else is working on is supposed to fix) 2022-03-18 01:52:58 tomalok: I am working on !26763 which creates "aavmf" files 2022-03-18 01:53:14 smcavoy: ah, speak of the person ;-) 2022-03-18 01:56:27 the QEMU_EFI.fd provided by the ovmf package on aarch64 did not work with LXD (using qemu) VMs. Qemu expected a specific length file/ location within the file for uefi bin. 2022-03-18 01:59:16 so I opened the MR. I still need to test the newly created files on both x86_64 and aarch64 to ensure stuff boots with them, at least with LXD. Will also look into how other platforms use them to avoid blowing up anything by changing the format.. 2022-03-18 02:01:38 smcavoy: i _think_ i just turned on notifications for myself on that MR... at least i think that's what that toggle did! ;) 2022-03-18 02:05:20 minimal: how far back should i consider making cloud-init images -- should i keep it recent (3.15 & edge) because older releases use older cloud-init (and it's not available in 3.12 at all) 2022-03-18 02:06:38 up to you, really, as you say 3.13 is when it first appeared in the repos. 2022-03-18 02:07:16 by co-incidence I started adding tiny-cloud to my disk-image scripts :-) 2022-03-18 02:07:45 heh, fair swap! :) 2022-03-18 02:14:41 btw, have you ever tested nvme drives with qemu? Doing some testing and I'm obviously not specifying the qemu options exactly right as it fails to detect boot device. If I enable qemu boot meu then I can manually select the nvme device and all is well.. 2022-03-18 02:14:55 s/meu/menu/ 2022-03-18 21:22:13 I have updated !26763, the new aavmf has been tested to produce .fd files that work with qemu (via lxd). Wondering about any other platforms expecting aarch64 ovmf files to continue to exist in /usr/share/OVMF .. 2022-03-18 22:43:49 smcavoy: alpine-cloud-images downloads the apk's and then extracts the .fd's -- so all we'd need to do for that is change that process to match, i think 2022-03-23 09:22:10 anyone tested the aarch64 3.15.1 release in amazon? It fails too boot in my vmware 2022-03-23 09:22:25 the linux-virt kernel appears to be broken somehow 2022-03-23 14:11:59 I did 3.15 2 release due to libretls security fix was not included in 3.15.1. 2022-03-23 14:28:50 as far as i can tell edge is not patched either 2022-03-23 14:29:03 don't they correspond to libressl releases, and it's 3.4.2 2022-03-23 14:29:06 not 3.4.3 2022-03-23 14:29:59 i have a bump+rebuilds all the way to 3.5.1 which fixes it too, but i think someone missed it, unless i don't know how it differs from libressl 2022-03-23 15:22:43 ncopa: looks like i spent way too much time fixing 3.12.10 (switched back to tiny-ec2-bootstrap, due to tiny-cloud dep on ifupdown-ng) and not enough on testing 3.15.1? 2022-03-23 15:23:28 ncopa - i don't have the full console output yet -- but the 3.15.1 i just launched on aws seems up 2022-03-23 15:24:39 apparently it was an issue with the mac os hypervisor 2022-03-23 15:27:11 would that hypervisor also be used via qemu or just vmware? (the builder would use the latest release ISO for the next builds) 2022-03-23 15:27:55 https://lore.kernel.org/stable/907327093697278cd816aafec9e20b3e@kernel.org/T/ 2022-03-23 15:28:23 They do mention qemu as well 2022-03-23 15:30:27 also mention that QEMU fixed it in how they handle HVF 2022-03-23 15:30:55 as long as that fix is in the latest qemu i'm probably okay 2022-03-23 15:35:08 kicking off a build now 2022-03-23 16:04:31 cloud images built & published -- ikke: https://gitlab.alpinelinux.org/alpine/infra/alpine-mksite/-/merge_requests/42 2022-03-23 16:06:36 https://wwwtest.alpinelinux.org/cloud/ 2022-03-23 16:07:37 lgtm 2022-03-23 16:11:51 pushed 2022-03-23 16:12:31 thx 2022-03-23 16:22:47 tomalok: thank you! 2022-03-23 16:23:10 yeah, it turned out to be apple hypervisor problem 2022-03-28 19:32:05 im tagging new stable releases now, to handle the zlib cve 2022-03-28 22:23:42 ncopa: i'll roll new cloud images after i'm done with DayJobâ„¢ 2022-03-29 03:35:10 ncopa & ikke - new cloud images published - https://gitlab.alpinelinux.org/alpine/infra/alpine-mksite/-/merge_requests/43 2022-03-29 04:37:42 tomalok: https://wwwtest.alpinelinux.org/cloud/ 2022-03-29 04:42:02 pushed to production 2022-03-29 08:36:58 tomalok: thank you!