Commit Graph

527 Commits

Author SHA1 Message Date
Frikky 82fa9e8ccc Merge pull request #1825 from yashsinghcodes/main
Default k8s deployment using helm charts
2025-10-02 09:49:23 +02:00
yashsinghcodes dcc20e9c84 fix default k8 deployment 2025-10-02 01:58:12 +05:30
Frikky b039222117 Merge pull request #1820 from Shuffle/main
Syncing new fixes in main back to nightly
2025-09-28 18:09:05 +02:00
Aditya 7612b4b7bb docs: a few more ideas about auto scale 2025-09-17 17:56:57 +05:30
Frikky 5da98c1d0c Re-added SHUFFLE_BASE_IMAGE_NAME usage, and made REGISTRY+BASE IMAGE setting ensure that PullAlways is used to always use latest local image 2025-09-16 16:00:47 +02:00
Frikky fc9c01abbb Fixed opensearch indexing issue in bulk 2025-09-12 08:16:18 +02:00
Frikky a046c3a96b Made service cleanup REQUIRE CLEANUP=true. This is opposite, now that we have workers that can self-discover services. 2025-09-10 01:50:10 +02:00
Frikky 26d10c788c Disabled the Node Scale mechanism, as it was just confusing. SHUFFLE_APP_REPLICAS and SHUFFLE_SCALE_REPLICAS are self-controlled. 2025-09-10 01:46:19 +02:00
Frikky 85fd0e1abc Made swarm init more robust 2025-09-10 01:41:33 +02:00
Frikky 61d30d9fb2 Minor print fixes to orborus/worker 2025-09-09 16:00:53 +02:00
Frikky 67cd5a3e60 Synced all 2.1.0 fixes 2025-09-01 19:19:34 +02:00
Frikky 00384fa0ea Added debug to orborus 2025-08-29 14:56:41 +02:00
Frikky d721479122 Minor tweaks for cloud & onprem execs 2025-08-29 14:16:26 +02:00
Frikky 288a9b1d01 Minor fixes for Orborus and Worker 2025-08-29 14:15:24 +02:00
Frikky a8dc56daa5 Added CLEANUP=false to disable swarm cleanup in general. Use autodiscovery instead 2025-08-29 13:53:27 +02:00
Frikky 10215e0e56 Increased default concurrency to 50 on swarm to not lag behind at scale 2025-08-29 13:37:44 +02:00
Frikky 95dd31fb3a Merge branch 'main' into nightly 2025-08-28 21:49:42 +02:00
Frikky a88c66a832 Fixes for datastore and scale for 2.1.0 2025-08-28 14:29:05 +02:00
Frikky 1a9daf046c Rebuild again yay 2025-08-27 14:10:06 +02:00
Frikky 4fe311cc99 Opensearch and app optimisations 2025-08-27 12:54:50 +02:00
Frikky 3c32a22614 Rebuild \o/ 2025-08-27 01:15:29 +02:00
Frikky 2b639ceae3 Increased timeouts and rerun mechanisms. Autofixes are now more and more in place by default 2025-08-27 01:10:28 +02:00
Frikky f82c4751d4 Minor tweaks to opimise container deploments 2025-08-26 23:54:11 +02:00
Frikky 69df46f067 Rebuild with proper files :3 2025-08-26 23:17:47 +02:00
Frikky d2fcc2c3eb Fixed environment management and minor bugs onprem 2025-08-26 19:32:30 +02:00
Frikky 15bf1011e7 Bumped versions to match shuffle-shared and singul 2025-08-26 14:03:30 +02:00
Frikky ca68f4635d Cleaned up worker and orborus to point to url properly 2025-08-25 21:44:54 +02:00
Frikky c729baedc6 Made sure SHUFFLE_BASE_IMAGE_REGISTRY is passed for k8s, and that registry/basepath/imagename:version now works 2025-08-25 21:41:17 +02:00
Frikky 220547fe4a Merge conflict fix 2025-08-22 00:02:57 +02:00
Frikky 065dc160b3 More delay and network management when issues occur 2025-08-22 00:02:11 +02:00
Yash Singh decf45ed22 Merge pull request #1792 from yashsinghcodes/new-nightly
chore: shuffle-shared bump
2025-08-21 16:36:37 +05:30
yashsinghcodes 3167756c61 comment autoscale back 2025-08-21 16:36:16 +05:30
yashsinghcodes fcf36f1b86 chore: shuffle-shared bump 2025-08-21 16:34:51 +05:30
Pascal Sthamer feaee08333 fix(k8s): pass SHUFFLE_LOGS_DISABLED env var from orborus -> worker -> app
Signed-off-by: Pascal Sthamer <10992664+P4sca1@users.noreply.github.com>
2025-08-20 11:31:53 +02:00
Yash Singh 5ba5d2fb3d Merge pull request #1786 from yashsinghcodes/new-nightly
chore: bump shuffle-shared
2025-08-18 13:58:10 +05:30
yashsinghcodes 02000d7e00 chore: bump shuffle-shared 2025-08-18 13:56:42 +05:30
Aditya acd2116a49 fix: adding debug log fixes 2025-08-01 21:39:30 +05:30
yashsinghcodes 5880cb525c chore: shuffle-shared sync up 2025-07-21 18:24:23 +05:30
Frikky a399d8b2c6 More dockerfile bumps 2025-07-18 14:57:30 +02:00
Frikky 10f49a6e52 Merge branch 'main' of https://github.com/shuffle/shuffle 2025-07-18 14:36:29 +02:00
Frikky 3c46e88970 Removed all irrelevant files 2025-07-18 14:36:24 +02:00
yashsinghcodes ff4a63daea shuffle-shared sync up 2025-07-09 14:46:39 +05:30
yashsinghcodes 074709c7bb fix orborus issues 2025-06-26 20:02:50 +05:30
yashsinghcodes 00ffd7bfa8 fixes some of the issue in 2.1.0-rc2 2025-06-26 02:47:29 +05:30
Frikky 7cf93ecfdc Orborus/worker rerun 2025-06-17 20:59:22 +02:00
Frikky 7c15f58617 Added High Availability control and failovers for Orborus with SHUFFLE_ORBORUS_UUID. Requires shuffle 2.1.0 or higher 2025-06-16 19:20:05 +02:00
yashsinghcodes f3678fcfdc fix for defaultNetwork failing service deployments 2025-05-20 01:23:25 +05:30
Frikky d1a0806a8a Cleaned up shuffle-shared references 2025-05-19 00:23:59 +02:00
Frikky 7bc246c003 Merge pull request #1691 from P4sca1/k8s-service-type-clusterip
fix(k8s): expose worker and apps using ClusterIP service instead of NodePort
2025-05-18 23:33:12 +02:00
Frikky ed70913be5 Merge branch 'nightly' into k8s-shuffle-app-ports 2025-05-18 22:48:47 +02:00