Quanyi Li
37d4e72db5
Fix bug for generating dataset ( #2 )
...
* update parameters for scripts
* update write function
* modify waymo script
* use exist ok instead of overwrite
* remove TODO
* rename to comvine_dataset
* use exist_ok and force_overwrite together
* format
* test
* creat env for each thread
* restore
* fix bug
* fix pg bug
* fix
* fix bug
* add assert
* don't return done info
* to dict
* add test
* only compare sdc
* no store mao
* release memory
* add start index to argumen
* test
* format some settings/flags
* add tmp path
* add tmp dir
* test all scripts
* suppress warning
* suppress warning
* format
* test memory leak
* fix memory leak
* remove useless functions
* imap
* thread-1 process for avoiding memory leak
* add list()
* rename
* verify existence
* verify completeness
* test
* add test
* add default value
* add limit
* use script
* add anotation
* test script
* fix bug
* fix bug
* add author4
* add overwrite
* fix bug
* fix
* combine overwrite
* fix bug
* gpu007
* add result save dir
* adjust sequence
* fix test bug
* disable bash scri[t
* add episode length limit
* move scripts to root dir
* format
* fix test
2023-05-13 15:15:31 +01:00
QuanyiLi
944c7f3707
fix test
2023-05-08 17:41:22 +01:00
Quanyi Li
a8669ae730
Merge pull request #1 from metadriverse/initial-commit
...
Initial commit
2023-05-08 17:38:58 +01:00
QuanyiLi
cce4d2d43e
add filters to combine script
2023-05-08 17:37:53 +01:00
QuanyiLi
25e911f22d
fix test
2023-05-08 17:30:09 +01:00
QuanyiLi
500f69f3fb
fix CI
2023-05-08 17:19:15 +01:00
QuanyiLi
e97068ca86
fix bug
2023-05-08 17:16:57 +01:00
QuanyiLi
5c3e516c06
install md for github test
2023-05-08 17:15:58 +01:00
QuanyiLi
3830fca97c
remove annotation
2023-05-08 17:14:22 +01:00
QuanyiLi
f089e9e118
16 workers
2023-05-08 17:11:34 +01:00
QuanyiLi
02ddbd1662
fix bug
2023-05-08 17:09:14 +01:00
QuanyiLi
b5418ba3f6
fix bug
2023-05-08 17:07:24 +01:00
QuanyiLi
63d6cb2c1a
.sh
2023-05-08 16:59:51 +01:00
QuanyiLi
8802c6dcf6
update error message
2023-05-08 16:57:36 +01:00
QuanyiLi
c080da25a7
test more scripts
2023-05-08 16:55:45 +01:00
QuanyiLi
37a7d8608e
add dataset to gitignore
2023-05-08 16:31:35 +01:00
QuanyiLi
bf53687cc3
fix bug
2023-05-08 16:28:28 +01:00
QuanyiLi
3c6d562718
add num works to script arguments
2023-05-08 16:26:26 +01:00
QuanyiLi
53abbc0152
more test
2023-05-08 16:22:32 +01:00
QuanyiLi
c5b0aa8f07
fix bug
2023-05-08 16:18:20 +01:00
QuanyiLi
f610e622a8
add more test
2023-05-08 16:17:27 +01:00
QuanyiLi
348ee642c8
test combine data
2023-05-08 16:11:46 +01:00
QuanyiLi
09f46bbc3f
fix combine bug
2023-05-08 16:07:05 +01:00
QuanyiLi
678cffa613
add combine API
2023-05-08 15:40:22 +01:00
QuanyiLi
fba52b7f8c
batch generation
2023-05-08 15:30:51 +01:00
QuanyiLi
a9c2b58edc
merge automatically
2023-05-08 15:27:22 +01:00
QuanyiLi
bbef2db107
set waymo origin path
2023-05-08 15:17:13 +01:00
QuanyiLi
2f8f9159c2
add local test for generating local dataset
2023-05-08 14:54:35 +01:00
QuanyiLi
436cbd3ab3
test waymo converter
2023-05-08 14:48:27 +01:00
QuanyiLi
7b44e99d88
multi-process writing
2023-05-08 14:14:15 +01:00
QuanyiLi
97ae6addf6
multi processing get files
2023-05-08 13:53:57 +01:00
QuanyiLi
9483b8fc56
disable info output
2023-05-08 13:40:52 +01:00
QuanyiLi
7ffbf763bd
add script for parsing data
2023-05-08 13:39:11 +01:00
QuanyiLi
b73dd086a2
scale up test
2023-05-08 13:30:41 +01:00
QuanyiLi
3779f680ed
reanme
2023-05-08 13:29:20 +01:00
QuanyiLi
720fc61d72
add test
2023-05-08 13:28:33 +01:00
QuanyiLi
50d338da17
provide scripts
2023-05-08 13:26:41 +01:00
QuanyiLi
ed8fed4c1b
move all test genrtaed file to tmp, add genertae error set test
2023-05-08 12:52:41 +01:00
QuanyiLi
b2d48c85ee
add common utils
2023-05-08 12:31:52 +01:00
QuanyiLi
104f03fbf4
add new test
2023-05-08 12:07:09 +01:00
QuanyiLi
817e7c173c
build new dataset from error logs
2023-05-08 11:40:47 +01:00
QuanyiLi
297f0d59f0
use is_scenario_file to determine
2023-05-08 10:27:02 +01:00
QuanyiLi
b85be760c1
auto reduce worker num
2023-05-08 10:02:13 +01:00
QuanyiLi
730efa86a8
format
2023-05-07 23:18:45 +01:00
QuanyiLi
97a4e61f38
multi-processing test
2023-05-07 23:18:33 +01:00
QuanyiLi
5c1b2e053b
small dataset test!
2023-05-07 23:01:01 +01:00
QuanyiLi
25bb9764c8
multi_processing test
2023-05-07 22:54:37 +01:00
QuanyiLi
5ba769c201
multiprocess verify
2023-05-07 22:13:00 +01:00
QuanyiLi
1c81399256
finish filter
2023-05-07 21:29:14 +01:00
QuanyiLi
468cff9040
add filter test
2023-05-07 20:41:46 +01:00