baohan
/
clusterdata
0
0
Fork 1
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GPU] Replace Git LFS with Aliyun OSS

This commit is contained in:
qzweng 2023-03-20 21:31:03 +08:00
parent fbfe2e24ee
commit 02a1be14f8
11 changed files with 32 additions and 23 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
cluster-trace-gpu-v2020/README.md
View File

@ -83,8 +83,17 @@ Below is a brief description of all the tables; the details are deferred to thei
- **pai_machine_spec**: machine specification.
- **pai_machine_metric**: machine resource metrics with respect to the instance.
(**Note**: the data in `./data` folder, due to its large volume, is encouraged to be downloaded via [Git LFS](https://git-lfs.github.com/))
**Note**: the data in `./data` folder, due to its large volume, is encouraged to be downloaded via ~~[Git LFS](https://git-lfs.github.com/)~~ [Aliyun OSS](https://www.aliyun.com/product/oss):
- [pai_group_tag_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_group_tag_table.tar.gz)
- [pai_instance_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_instance_table.tar.gz)
- [pai_job_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_job_table.tar.gz)
- [pai_machine_metric.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_metric.tar.gz)
- [pai_machine_spec.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_spec.tar.gz)
- [pai_sensor_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_sensor_table.tar.gz)
- [pai_task_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_task_table.tar.gz)
(Alternative: [data repo on GitHub](https://github.com/qzweng/clusterdata-cluster-trace-gpu-v2020-data))
**Checksum** (replacing `sha256sum` with `shasum` for macOS users)
```bash

1
cluster-trace-gpu-v2020/data/.gitattributes vendored
View File

@ -1 +0,0 @@
*.tar.gz filter=lfs diff=lfs merge=lfs -text

15
cluster-trace-gpu-v2020/data/README.md Normal file
View File

@ -0,0 +1,15 @@
# Trace data
Due to the recent surge in pulls, this repository is over the LFS quota. We have tried to bypassed the problem by providing the traces via [Aliyun OSS](https://www.aliyun.com/product/oss). The files can be downloaded as follows:
- [pai_group_tag_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_group_tag_table.tar.gz)
- [pai_instance_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_instance_table.tar.gz)
- [pai_job_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_job_table.tar.gz)
- [pai_machine_metric.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_metric.tar.gz)
- [pai_machine_spec.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_spec.tar.gz)
- [pai_sensor_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_sensor_table.tar.gz)
- [pai_task_table.tar.gz](https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_task_table.tar.gz)
(Alternative: [data repo on GitHub](https://github.com/qzweng/clusterdata-cluster-trace-gpu-v2020-data))
Thank you for your support and understanding!

7
cluster-trace-gpu-v2020/data/download_data.sh Executable file
View File

@ -0,0 +1,7 @@
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_group_tag_table.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_instance_table.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_job_table.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_metric.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_machine_spec.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_sensor_table.tar.gz
curl -O https://aliopentrace.oss-cn-beijing.aliyuncs.com/v2020GPUTraces/pai_task_table.tar.gz

3
cluster-trace-gpu-v2020/data/pai_group_tag_table.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:722fef30b7fb7aa50dabd79155614b5423a9d65cf45a9b26c590d57725423a14
size 55064781

3
cluster-trace-gpu-v2020/data/pai_instance_table.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bf1e423a7ce3f8d086699801c362fd56a7182abdb234139e5ebbed97995ca06
size 694839139

3
cluster-trace-gpu-v2020/data/pai_job_table.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5aad7f7caac501136d14ed6a48e40546f825d7b0617a3a4f337e2348fe0a6cb0
size 62065432

3
cluster-trace-gpu-v2020/data/pai_machine_metric.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53ad917193d3b1dd0f3055e723148b1f36c2f81789b014ea2930a7875892eef5
size 206596175

3
cluster-trace-gpu-v2020/data/pai_machine_spec.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc0d38a4045af1b1af8179de8b1b54b1ddd995e6160d6d061a6b1000f1276c2d
size 30449

3
cluster-trace-gpu-v2020/data/pai_sensor_table.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a0b82e8bdf3949281e4ba1423d9b4b34847e52799eecb138966de46da69c7a0
size 406119947

3
cluster-trace-gpu-v2020/data/pai_task_table.tar.gz
View File

@ -1,3 +0,0 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd1d6dc3215d2a8607ccf6b6dd952b5db776df86926c73259fea7c1499ac40e5
size 35514117