Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More APIs for high-level library development #852

Open
ZhiyuanChen opened this issue Nov 15, 2022 · 0 comments
Open

More APIs for high-level library development #852

ZhiyuanChen opened this issue Nov 15, 2022 · 0 comments
Labels
enhancement New feature or request feature request Request for a new feature to be added to Accelerate

Comments

@ZhiyuanChen
Copy link
Contributor

ZhiyuanChen commented Nov 15, 2022

Hi,

I have been developing a high-level library for PyTorch and Accelerate for quite some time.
The reason why I'm doing it is because I'm tooooo lazy to write all the logging and IO stuff, but I still want full control with the training loop (nobody tells me how to train my model.
Accelerate has been the core component of my framework now, some of it were extracted out and merge into accelerate, e.g., #488.

There are still sometimes I find it's hard to go, for example, load_accelerator_state and save_accelerator_state. It would be better if there is an additional get_accelerator_state, set_accelerator_state so that I can wrap it inside my checkpoint.
There were a few more examples in my mind... but unfortunately I forget them now.... I'll come back later.

@muellerzr muellerzr added enhancement New feature or request feature request Request for a new feature to be added to Accelerate labels Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature request Request for a new feature to be added to Accelerate
Projects
None yet
Development

No branches or pull requests

2 participants