Compare commits

..

39 Commits
main ... matrix

Author SHA1 Message Date
Cornelius Specht 2443fcf2e3 add optimizer
ci/woodpecker/push/woodpecker/2 Pipeline was successful Details
ci/woodpecker/push/woodpecker/1 Pipeline was successful Details
ci/woodpecker/push/woodpecker/4 Pipeline was successful Details
ci/woodpecker/push/woodpecker/3 Pipeline was successful Details
2024-06-13 11:37:49 +02:00
Cornelius Specht e24b6eef5a add epochs to py
ci/woodpecker/push/woodpecker/1 Pipeline was successful Details
ci/woodpecker/push/woodpecker/2 Pipeline was successful Details
2024-06-13 11:28:56 +02:00
Cornelius Specht 05291f41f6 add matrix
ci/woodpecker/push/woodpecker/1 Pipeline was successful Details
ci/woodpecker/push/woodpecker/2 Pipeline was successful Details
2024-06-13 11:22:06 +02:00
Malte Grosse 7a3c6f8393 bla
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-05-27 10:29:55 +02:00
Malte Grosse 6e2731ea0f test
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-05-23 21:35:06 +09:00
Malte Grosse 78c2e66855 15
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-05-23 21:34:20 +09:00
Malte Grosse 6d896e921b 10
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-05-23 19:34:22 +09:00
Malte Grosse 67f6ecbbb9 try without limit
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-04-11 16:44:03 +09:00
Malte Grosse b3fdc6dcf6 go
ci/woodpecker/push/woodpecker Pipeline was successful Details
2024-04-11 16:07:42 +09:00
Malte Grosse b966a664aa 50k
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-12-11 08:01:42 +09:00
Malte Grosse cb1b4c6da1 2nd
ci/woodpecker/push/woodpecker Pipeline failed Details
2023-11-30 20:36:57 +09:00
Malte Grosse 547aca11bf 10k 16h
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 20:36:07 +09:00
Malte Grosse 9f1a7897cb 3rd
ci/woodpecker/push/woodpecker Pipeline is pending Details
2023-11-30 20:20:22 +09:00
Malte Grosse 9d75a10e93 2nd
ci/woodpecker/push/woodpecker Pipeline is pending Details
2023-11-30 20:20:08 +09:00
Malte Grosse 83094016ba 100000
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 17:12:43 +09:00
Malte Grosse 2701b15f28 add 100 epochs
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 16:29:21 +09:00
Malte Grosse e55ab32bb1 train
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 10:24:33 +09:00
Malte Grosse 147b8f63f5 added
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 10:21:14 +09:00
Malte Grosse 02ea29fda0 z
ci/woodpecker/push/woodpecker Pipeline is running Details
2023-11-30 10:14:54 +09:00
Malte Grosse b84864841a upload
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 10:09:07 +09:00
Malte Grosse 511187ba16 gpu
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 10:04:15 +09:00
Malte Grosse 45d58b7723 rem mat
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-30 09:58:35 +09:00
Malte Grosse c1c2795e42 try
ci/woodpecker/push/woodpecker Pipeline failed Details
2023-11-30 09:45:04 +09:00
Malte Grosse 9ffb755608 3
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-29 09:39:35 +09:00
Malte Grosse f97151f785 r
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-29 09:23:23 +09:00
Malte Grosse 8c03b5f688 1
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-29 09:18:07 +09:00
Malte Grosse 2850c3ebd9 gpu
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-29 09:09:42 +09:00
Malte Grosse 85f6d50cf7 init
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-29 09:05:37 +09:00
Malte Grosse ca2071e7ca last
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 23:00:30 +09:00
Malte Grosse 122c4ffe03 b
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:56:29 +09:00
Malte Grosse 0d08778c74 a
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:56:20 +09:00
Malte Grosse 01363eab00 10
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:54:21 +09:00
Malte Grosse d7fc8fc080 6
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:52:24 +09:00
Malte Grosse be73ea86b9 5 2023-11-28 22:50:43 +09:00
Malte Grosse 4603bb64a7 4 2023-11-28 22:48:30 +09:00
Malte Grosse 76b687bb9c 3
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:45:48 +09:00
Malte Grosse dc80437156 3
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 22:25:41 +09:00
Malte Grosse 7a09a37cd4 2
ci/woodpecker/push/woodpecker Pipeline was successful Details
2023-11-28 21:39:40 +09:00
Malte Grosse 88d5eff787 1
ci/woodpecker/manual/woodpecker Pipeline failed Details
2023-11-28 21:36:54 +09:00
3 changed files with 17 additions and 9 deletions

View File

@ -1,8 +1,16 @@
matrix:
EPOCHS:
- 20
- 30
OPTIMIZER:
- adam
- SGD
steps: steps:
"train": "train":
image: nvcr.io/nvidia/tensorflow:23.10-tf2-py3 image: nvcr.io/nvidia/tensorflow:23.10-tf2-py3
commands: commands:
- echo "starting python script sd " - echo "starting python script"
- python run.py - python run.py
"compress and upload": "compress and upload":
image: alpine:3 image: alpine:3

View File

@ -1,4 +0,0 @@
# Long Running Trainings
This repository contains an example pipeline for long running training tasks.
Detailed information can be found at the official [Sandbox Documentation](https://docs.sandbox.iuk.hdm-stuttgart.de/sandbox/training.html).

10
run.py
View File

@ -8,6 +8,10 @@ import os
from keras import backend as K from keras import backend as K
K.clear_session() K.clear_session()
EPOCHS = int(os.getenv("EPOCHS", default = 10))
OPTIMIZER = os.getenv("OPTIMIZER", default = "SGD")
gpus = tf.config.experimental.list_physical_devices('GPU') gpus = tf.config.experimental.list_physical_devices('GPU')
# if gpus: # if gpus:
# try: # try:
@ -17,7 +21,7 @@ gpus = tf.config.experimental.list_physical_devices('GPU')
# os.exit(1) # os.exit(1)
print(tf.config.experimental.list_physical_devices()) print(tf.config.experimental.list_physical_devices())
print("test")
print(tf.__version__) print(tf.__version__)
print(tf.test.is_built_with_cuda()) print(tf.test.is_built_with_cuda())
@ -68,10 +72,10 @@ with tf.device('/GPU:0'):
keras.layers.Dense(10, activation='sigmoid') keras.layers.Dense(10, activation='sigmoid')
]) ])
# g # g
model.compile(optimizer='SGD', model.compile(optimizer=OPTIMIZER,
loss='categorical_crossentropy', loss='categorical_crossentropy',
metrics=['accuracy']) metrics=['accuracy'])
model.fit(X_train_scaled, y_train_categorical, epochs=25) model.fit(X_train_scaled, y_train_categorical, epochs=EPOCHS)
model.save('mymodel.keras') model.save('mymodel.keras')
print("finished training") print("finished training")