feat(raw_data): add parameter validation for data portal job (#849)

* feat(raw_data): add parameter validation for data portal job

* fix pylint

[WebConsole] Sync to github. (#842)

commit ddb0e6b81b27a119a4d88dc0670cee84e1ba48f3
fix(project): fix connection_check fetch multiple times

commit 254eb95ac90728a2cebe3ca0dbb7f28ee9c034a8
fix(jwt): adds jwt_required for APIs

commit b15ebbc8e8e97a4df7aaaec75e4061e3fc13ffeb
fix(webconsole): fix user can get others information

commit 4f25d47ef093bc33c663ca946979c9801e3152c0
fix(webconsole): fix there isn't a web request when logout

commit 786ad520471a3500d41f3f650f8e54f867121c43
fix(edit): crash when peer workflow has no job

commit f80839e842810081e19a884d73090a5d0c577d1c
feat(template): add self ref for yaml_template

commit 9d37deb5a9ce6e837ed8da47582d4893ffb31dff
chore(makefile): let make unittest run a limited set of unit tests

commit bae9191f3596ed7cce8dde5ee91fae48b5a6b3ce
fix(users): fix users page no role check

commit 653afaf123f6f5bd56accee86c693937c03de5cd
chore(copyright): add a tool to change copyright year

commit fab5d09397ee56768c35607360f6947aad1f2865
chore(mmgr): rename db column `mark` to `extra`

commit 44cb474bc115d5404f177c528445b81589ce4ee8
feat(template): add JOB_PROP reference type to support using job.name

commit 7e5605578460b3d19bd5bf1f0627a1a82fa98b88
fix(webconsolev2): move is_used flag to jobdefinition level, and rename

commit 30fcf7763cea768bf97bb6881cbf27782f2a09de
feat(check_inheritance): check_peer_job_inheritance

commit f5e738af77946d368ac2d5975e87d9c8c58c101a
feat(mmgr): create and update model records automatically

commit 8adeb7f24938015a56dbaa1993f9df84eba74140
feat(webconsole): add pod ip display

commit c5a4691826c87f6fe2e2f18157b4eadf2ccea1c3
feat(db): support mysql5.7+

commit 1a034d05a30313f5bc3cf52196971ff88542e07b
chore(password): change a complex password

commit 2d22171bba73dd7d29995a371719d6166fec92e3
chore: upgrade python to 3.7 in docker image

commit d2e71ff1aa8125600f4f65c7a4a71306d7b23e2b
feat(envs): add feature flag

commit 653da9def3e69a15bf3d7375a8c60b074a0b6afd
feat(dataset): support editing dataset name and comment

commit fd70694845110f41e264255e04e01db4cf150d54
fix(dataset): failing to import files in fs

commit a2d73b6b3abd9bcdce35b57adbd5ac11e1a6415d
fix(deploy): remove setting peer during install

commit 3cde34dd87222a65787540dbff56cd25a5f49cfb
feat(detail): support inspect peer side kibana metrics

commit 1c460587c969185dd6610624988cf1c25e09439d
fix(deploy): ingress name

commit ffcf8d00eb297b7a98fe37c92f453744567f688e
feat(spark-image): add entrypoint for spark

commit 276b41a6edb822e318918ad35c8bf8de99ecb10f
feat(sparkapp): add labels hook

commit dbe72e58c8bd80944e4aeb722ea38e2c3b5632d2
feat(local_runner): for easier testing

commit 9cca2e99fe4e7616a6a5854da769903744c0f6a6
fix(release-tool): fix release tools tce upgrade version

commit cdf6e6614b3df789648db38c7bea0beb5a7a7d86
feat(support_tree_metrics): support tree in plot_metrics

commit f69396ddd14f98c0fbbf3a9751ca6515b12cc0c6
feat(sparkapp): add sparkapp api

commit 24c6ab80eddca7b1a82ab781f39b7e5b3d77771d
Revert "feat(mmgr): update model state from k8s_watcher [skipped]"

This reverts commit ba4086330cc36d5eb56bd067290170a14f9ef98a.

commit ba4086330cc36d5eb56bd067290170a14f9ef98a
feat(mmgr): update model state from k8s_watcher [skipped]

commit f34df33cd2037e2c0cb7e55374d9ebe294572059
feat(mixins): add from_dict and to_dict mixins

Co-authored-by: root <root@codebaseci.byted.org>

fix(deploy): wrong key name for mysql storageClass (#828)

trainer_v1.1 (#797)

* feat: export model from ps

fix: channel will catch grpc.StatusCode.UNIMPLEMENTED, then retry

v1.0.0 (#785)

add CODE_TAR for trainer worker (#698)

* add code_tar to .sh

* complete test

* fix

Co-authored-by: xiangyuxuan.prs <xiangyuxuan.prs@bytedance.com>

Attribution support (#418)

* Support attribution

* Feature: enable negative example auto-generate

* Fix unexpected converion of bool in argparse

* Bugfix: meta.example_ids maybe dup

* Code format

* Add log

* Pass the neg generating flag

* Pass the neg generating flag

Co-authored-by: duanbing.0 <duanbing.0@bytedance.com>

Update to rc2 and add release iamge (#394)

Bulk Merge v1.5 WebConsole Changes. See #362 (#386)

* Add job/update functionality

* fix

* add migration

* fix

* fix

* fix

* fix

* fix

* fix

* add heartbeat webconsole

* fix

* trigger

* Add migration create table

* Add client side job validation

* Fix create/update job

* fix

* Feat/datasource (#328)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* Feat/datasource (#330)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* ds bug fix (#331)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* change delete job logic

* feat: use full params to set default (#338)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* Fix form defaults

* Fix client_params & server_param inversion

* feat: config replica type (#339)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* add replica workers (#340)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

* fix: replica num

* feat: add replica workers

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* bug fix (#346)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

* fix: replica num

* feat: add replica workers

* fix: data source and worker nums fill

* fix: replicas is null

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* fix pod-log pod-shell (#351)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

* fix: replica num

* feat: add replica workers

* fix: data source and worker nums fill

* fix: replicas is null

* fix: pod-log pod-shell

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* Update server.js

* remove replicas from data join jobs default

* move DataSource select to ticket (#354)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

* fix: replica num

* feat: add replica workers

* fix: data source and worker nums fill

* fix: replicas is null

* fix: pod-log pod-shell

* fix: move datasource select from job to ticket

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* feat: federation config (#356)

* feat(web_console): form json

* chore(web_console): make form fields immutable
* mask sensitive data

* fix: lock version

* feat(web_console): support popover on nav tab

* feat(WIP): datasource

* feat(web_console): use form meta to implement form convert

* chore(web_console): update doc

* feat(web_console): raw data form:
* form utils unit test
* fix logic of `fillJSON`

* fix: raw data submit:
* fix federation value validator

* fix: image should be written into context

* fix: async response on submit

* fix: ticket not clone job

* chore: use `useMemo` with form fields

* feat(web_console): rewrite `fiilJSON`:
* support two array mode

* feat(WIP): datasource job form
* form item `name-value` support ignore keys
* incremental update form value in group type change
* TODO: form submit

* feat(web_console): boolean select in form

* feat(WIP): datasource ticket
* fix header active tab

* feat(web_console): datasource and trainning

* fix(web_console): ticket
* update form
* create ticket
* job link
* add `filterArrayValue`

* fix(web_console): clone job

* feat(web_console): stop and start job

* fix: update job status

* feat: job federation id filter

* fix: job status

* fix: package-lock

* fix: prerender error

* fix: prerender error

* fix: boolean select;
* update router of charts

* fix: bool-select

* feat: header dropdown icon

* feat: federation heartbeat

* fix: clone job

* fix: heartbeat

* fix: server ticket select

* fix: raw data in clone

* fix: delete job rpc

* fix: clear formMeta on cancel

* chore: remove raw_data in job form

* feat: show total info of server ticket:
* fix create jon derect in the index
* fix server ticket pull in cloning

* fix: useEffect

* fix: server ticket info

* chore: remove mock data

* chore: fix typo

* feat: disable federation with filter

* fix: raw data fill:
* fix raw data appState

* fix: num_partitions

* fix: raw_data fill:
* TODO: figure out why not working in some conditions

* feat: use full params to set default:
* change default value when  modify job type

* feat: select datasource in training job

* feat: config replica type:
* feat update form value when update

* fix: hide env value in training

* Update form-default.js

* fix: replica num

* feat: add replica workers

* fix: data source and worker nums fill

* fix: replicas is null

* fix: pod-log pod-shell

* fix: move datasource select from job to ticket

* feat: federation config:
* fix init value of boolean

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* Add k8s settings default

* Add datasource_meta migrations

* chore: remove useless default

* Pass DB env args to pod

* Add new psi data join entry script

* update psi data join default json

* Fix bug in webconsole create job

* fix: env not update (#364)

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* Allow injecting form default from env var

* Add +x for scripts

* Turn off cmd display

* fix: v1.5 bugs (#376)

* fix: v1.5 bugs
* ticket raw data name
* form data not updated when editing ticket
* federation form checker

* chore: remove console.log

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* Fix form-default

* fix: job can not submit (#378)

* fix: job can not submit

* Update CommonJobList.jsx

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* Fix delete job error

* change Role assignment for PSI data join

* feat: code key (#381)

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* fix:  edit code key (#382)

* feat: code key

* fix: edit code key

* feat: search param data

* Update CommonTicket.jsx

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: Eric Junyuan Xie <piiswrong@users.noreply.github.com>

* fix: search exit condition (#383)

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* feat: clone ticket and rawdata (#384)

Co-authored-by: shenshihao <shenshihao.20@bytedance.com>

* build DATA_PATH from DATA_SOURCE for tree worker

* Full integrated test (#385)

* add csv data

* fix file_type for tree model

* add field 'label' to tfrecord_raw_data

* fix num_parallel

* add num_parallel for compatibility.

* Revert and add new fake feature in tfrecord raw data for tree model.
This reverts commit 8ca6061.

* modified tree trainer for debug purpose, will be reverted

* Revert debug, add send metrics in tree trainer, shrink raw data, full integrated test supported

This reverts commit 977cd45.

* add loss_type for run_tree_worker.sh

* eliminated data path

* add num_parallel for compatibility.

* Revert and add new fake feature in tfrecord raw data for tree model.
This reverts commit 8ca6061.

* modified tree trainer for debug purpose, will be reverted

* Revert debug, add send metrics in tree trainer, shrink raw data, full integrated test supported

This reverts commit 977cd45.

* rebased and modified defaults

* deleted csv data

Co-authored-by: zhangzihui <zhangzihui@bytedance.com>

Co-authored-by: Allen Shen <932142511@qq.com>
Co-authored-by: shenshihao <shenshihao.20@bytedance.com>
Co-authored-by: ADeltanp <45765741+ZhZhang711@users.noreply.github.com>
Co-authored-by: zhangzihui <zhangzihui@bytedance.com>