Add continue_from_checkpoint

[hiyuchang]

Description

As the title says.

Checklist

Please check the following items before code is ready to be reviewed.

• Code has passed all tests
• Docstrings have been added/updated in Google Style
• Documentation has been updated
• Code is ready for review

[hiyuchang]

/run-unittest

[github-actions]

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
52	50	2	0	0	0	1.3s

Failed Tests

Failed Tests ❌	Fail Message
❌ tests/common/config_test.py::TestConfig::test_all_examples_are_valid	The test failed in the call phase
❌ tests/common/config_test.py::TestConfig::test_load_default_config	The test failed in the call phase

Tests

Test Name	Status	Flaky	Duration
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss	✅		1ms
tests/buffer/file_test.py::TestFileBuffer::test_file_buffer	✅		3ms
tests/buffer/file_test.py::TestFileBuffer::test_file_reader	✅		1ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer	✅		1ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse	✅		7ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity	✅		2ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue	✅		4ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue	✅		5ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity	✅		4ms
tests/buffer/sql_test.py::TestSQLBuffer::test_create_sql_buffer	✅		5ms
tests/common/config_test.py::TestConfig::test_all_examples_are_valid	❌		1ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid	✅		1ms
tests/common/config_test.py::TestConfig::test_load_default_config	❌		5ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion	✅		1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion	✅		1ms
tests/common/vllm_test.py::TestModelWrapperSyncV0::test_generate	✅		43ms
tests/common/vllm_test.py::TestModelWrapperAsyncV0::test_generate	✅		42ms
tests/common/vllm_test.py::TestModelWrapperAsyncTPV0::test_generate	✅		53ms
tests/common/vllm_test.py::TestModelWrapperAsyncTPV1::test_generate	✅		56ms
tests/common/vllm_test.py::TestModelWrapperAsyncV1::test_generate	✅		41ms
tests/common/vllm_test.py::TestAPIServer::test_api	✅		27ms
tests/common/vllm_test.py::TestTokenizer::test_assistant_token_mask	✅		1ms
tests/explorer/explorer_test.py::BaseExplorerCase::test_explorer	✅		1ms
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer	✅		90ms
tests/explorer/explorer_test.py::TestExplorerCountdownNoEval::test_explorer	✅		95ms
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations	✅		5ms
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results	✅		21ms
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods	✅		15ms
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop	✅		9ms
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks	✅		8ms
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all	✅		8ms
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch	✅		14ms
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable	✅		1ms
tests/trainer/trainer_test.py::BaseTrainerCase::test_trainer	✅		1ms
tests/trainer/trainer_test.py::TestTrainerCountdown::test_trainer	✅		255ms
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer	✅		96ms
tests/trainer/trainer_test.py::TestTrainerGSM8K::test_trainer	✅		64ms
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer	✅		94ms
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer	✅		45ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_0_queue	✅		101ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_1_priority_queue	✅		98ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins	✅		5ms

Github Test Reporter by CTRF 💚

[hiyuchang]

/run-unittest

[github-actions]

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
52	52	0	0	0	0	1.3s

Tests

Test Name	Status	Flaky	Duration
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss	✅		1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss	✅		1ms
tests/buffer/file_test.py::TestFileBuffer::test_file_buffer	✅		2ms
tests/buffer/file_test.py::TestFileBuffer::test_file_reader	✅		1ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer	✅		1ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse	✅		6ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity	✅		2ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue	✅		4ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue	✅		4ms
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity	✅		4ms
tests/buffer/sql_test.py::TestSQLBuffer::test_create_sql_buffer	✅		4ms
tests/common/config_test.py::TestConfig::test_all_examples_are_valid	✅		1ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid	✅		1ms
tests/common/config_test.py::TestConfig::test_load_default_config	✅		4ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion	✅		1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion	✅		1ms
tests/common/vllm_test.py::TestModelWrapperSyncV0::test_generate	✅		44ms
tests/common/vllm_test.py::TestModelWrapperAsyncV0::test_generate	✅		42ms
tests/common/vllm_test.py::TestModelWrapperAsyncTPV0::test_generate	✅		53ms
tests/common/vllm_test.py::TestModelWrapperAsyncTPV1::test_generate	✅		54ms
tests/common/vllm_test.py::TestModelWrapperAsyncV1::test_generate	✅		41ms
tests/common/vllm_test.py::TestAPIServer::test_api	✅		28ms
tests/common/vllm_test.py::TestTokenizer::test_assistant_token_mask	✅		1ms
tests/explorer/explorer_test.py::BaseExplorerCase::test_explorer	✅		1ms
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer	✅		89ms
tests/explorer/explorer_test.py::TestExplorerCountdownNoEval::test_explorer	✅		102ms
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations	✅		5ms
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results	✅		21ms
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods	✅		15ms
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop	✅		9ms
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks	✅		8ms
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all	✅		8ms
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch	✅		14ms
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow	✅		1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable	✅		1ms
tests/trainer/trainer_test.py::BaseTrainerCase::test_trainer	✅		1ms
tests/trainer/trainer_test.py::TestTrainerCountdown::test_trainer	✅		239ms
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer	✅		96ms
tests/trainer/trainer_test.py::TestTrainerGSM8K::test_trainer	✅		64ms
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer	✅		106ms
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer	✅		44ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_0_queue	✅		101ms
tests/trainer/trainer_test.py::TestFullyAsyncMode::test_fully_async_mode_1_priority_queue	✅		101ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins	✅		5ms

Github Test Reporter by CTRF 💚

[yanxi-chen]

lgtm