Commit Graph

551 Commits

Author SHA1 Message Date
Frikky f638baefcf Made orborus less verbose 2025-10-24 16:54:32 +02:00
Frikky e4c290b79c Merge pull request #1841 from BogatikovM/apps_scaling
fix apps scaling for k8s shuffle
2025-10-16 20:30:39 +02:00
Frikky 696bb66c83 Merge pull request #1845 from PROCYDE/shuffle-app-protocol
feat(k8s): specify app protocol for worker and app services
2025-10-16 20:29:56 +02:00
Pascal Sthamer 45ed10405c go fmt
Signed-off-by: Pascal Sthamer <10992664+P4sca1@users.noreply.github.com>
2025-10-15 11:34:53 +02:00
Pascal Sthamer 68efb7111a feat(k8s): specify app protocol for worker and app services
Signed-off-by: Pascal Sthamer <10992664+P4sca1@users.noreply.github.com>
2025-10-15 11:32:53 +02:00
Pascal Sthamer 172d0d8d80 feat(k8s): allow to mount tmp volume to apps
Signed-off-by: Pascal Sthamer <10992664+P4sca1@users.noreply.github.com>
2025-10-15 11:31:43 +02:00
Frikky 39c7b1e7d0 More default behavior orborus configs 2025-10-15 11:07:41 +02:00
BogatikovM dde6099b90 fix apps scaling for k8s shuffle 2025-10-12 14:45:41 +04:00
yashsinghcodes 8822149e19 chore: bump shuffle-shared 2025-10-10 22:26:14 +05:30
Frikky 96f91d0e9e Orborus rebuild 2025-10-09 16:05:41 +02:00
Frikky 5bfb17c9b0 Added basic revisions for datastore keys 2025-10-07 17:13:08 +02:00
Frikky 35a86c2e47 More verbose details 2025-10-06 14:20:45 +02:00
Frikky 758fa9ebe1 More network attachments for Orborus <-> tenzir connectivity 2025-10-06 12:46:19 +02:00
Frikky 8821bed47f Bumped to 0.9.27 shared for orborus autobuild 2025-10-06 00:20:54 +02:00
Frikky 186e9d14e0 Rebuilding with /tmp:/tmp mapping in mind 2025-10-05 23:57:32 +02:00
Frikky 7dfbe3803d Minor orborus fix 2025-10-05 21:27:37 +02:00
Frikky 7cbd9456a2 More Orborus tweaks for Tenzir 2025-10-03 14:15:45 +02:00
Frikky 35aa4f194c Merge branch 'nightly' of https://github.com/shuffle/shuffle into nightly 2025-10-03 13:42:16 +02:00
Frikky d56b631b07 Nightly orborus rebuild 2025-10-03 13:42:11 +02:00
Frikky 73f677b3b2 Merge pull request #1794 from Onder7994/worker_request_limit
Worker. Add option to set k8s resources.
2025-10-03 10:57:34 +02:00
Frikky 82fa9e8ccc Merge pull request #1825 from yashsinghcodes/main
Default k8s deployment using helm charts
2025-10-02 09:49:23 +02:00
yashsinghcodes dcc20e9c84 fix default k8 deployment 2025-10-02 01:58:12 +05:30
Frikky b039222117 Merge pull request #1820 from Shuffle/main
Syncing new fixes in main back to nightly
2025-09-28 18:09:05 +02:00
Aditya 7612b4b7bb docs: a few more ideas about auto scale 2025-09-17 17:56:57 +05:30
Frikky 5da98c1d0c Re-added SHUFFLE_BASE_IMAGE_NAME usage, and made REGISTRY+BASE IMAGE setting ensure that PullAlways is used to always use latest local image 2025-09-16 16:00:47 +02:00
Frikky fc9c01abbb Fixed opensearch indexing issue in bulk 2025-09-12 08:16:18 +02:00
Frikky a046c3a96b Made service cleanup REQUIRE CLEANUP=true. This is opposite, now that we have workers that can self-discover services. 2025-09-10 01:50:10 +02:00
Frikky 26d10c788c Disabled the Node Scale mechanism, as it was just confusing. SHUFFLE_APP_REPLICAS and SHUFFLE_SCALE_REPLICAS are self-controlled. 2025-09-10 01:46:19 +02:00
Frikky 85fd0e1abc Made swarm init more robust 2025-09-10 01:41:33 +02:00
Frikky 61d30d9fb2 Minor print fixes to orborus/worker 2025-09-09 16:00:53 +02:00
Frikky 67cd5a3e60 Synced all 2.1.0 fixes 2025-09-01 19:19:34 +02:00
Frikky 00384fa0ea Added debug to orborus 2025-08-29 14:56:41 +02:00
Frikky d721479122 Minor tweaks for cloud & onprem execs 2025-08-29 14:16:26 +02:00
Frikky 288a9b1d01 Minor fixes for Orborus and Worker 2025-08-29 14:15:24 +02:00
Frikky a8dc56daa5 Added CLEANUP=false to disable swarm cleanup in general. Use autodiscovery instead 2025-08-29 13:53:27 +02:00
Frikky 10215e0e56 Increased default concurrency to 50 on swarm to not lag behind at scale 2025-08-29 13:37:44 +02:00
Frikky 95dd31fb3a Merge branch 'main' into nightly 2025-08-28 21:49:42 +02:00
Frikky a88c66a832 Fixes for datastore and scale for 2.1.0 2025-08-28 14:29:05 +02:00
Frikky 1a9daf046c Rebuild again yay 2025-08-27 14:10:06 +02:00
Frikky 4fe311cc99 Opensearch and app optimisations 2025-08-27 12:54:50 +02:00
trusihin.andrey b6e9005037 Fix variables name 2025-08-27 09:26:47 +03:00
Frikky 3c32a22614 Rebuild \o/ 2025-08-27 01:15:29 +02:00
Frikky 2b639ceae3 Increased timeouts and rerun mechanisms. Autofixes are now more and more in place by default 2025-08-27 01:10:28 +02:00
Frikky f82c4751d4 Minor tweaks to opimise container deploments 2025-08-26 23:54:11 +02:00
Frikky 69df46f067 Rebuild with proper files :3 2025-08-26 23:17:47 +02:00
Frikky d2fcc2c3eb Fixed environment management and minor bugs onprem 2025-08-26 19:32:30 +02:00
trusihin.andrey dd89bbdd33 Remove SHUFFLE_WORKER_* env from orborus.go 2025-08-26 18:10:12 +03:00
trusihin.andrey f26f872835 Rename k8s resources envs. Add the same options to shuffle app 2025-08-26 16:24:01 +03:00
trusihin.andrey 4850526198 Worker. Add option to set k8s resources. 2025-08-26 15:09:39 +03:00
Frikky 15bf1011e7 Bumped versions to match shuffle-shared and singul 2025-08-26 14:03:30 +02:00