Tracking issues of RFC-3911: Deleter API

[Xuanwo]

• RFC: RFC-3911: Deleter API #3911

Tasks

• refactor: Implement RFC-3911 Deleter API  #5392
  • Raw API: Add oio::Delete
  • Raw API: Change delete to return oio::Delete in Accessor
  • Raw API: Remove batch API
  • Public API: Add deleter to Operator
• Public API: Deprecate remove, remove_via APIs
• Remove batch capability
• Add recursive support
  • feat: Add simulation for delete with recursive #6824
  • feat: Add delete with recursive support for fs #6827
  • azdls : feat(services/azdls): add recursive deletion for azdls #7142
  • webdav
  • webhdfs
  • hdfs : feat(services/hdfs): add delete with recursive support for hdfs #7136
  • hdfs_native
  • dropbox
• Add concurrent support

In the future

• Implement dtrace support for lister and deleter
• Implement oteltrace support for deleter
• implement batch delete for obs
• implement batch delete versioned object for oss
• Implement delete version check for deleter

[howiieyu]

If I understand correctly, there are a few typos in the RFC.

L37 in RFC text.

+  pub async fn delete_with(&self, path: &str) -> FutureDelete;

delete_with already return Future, async keyword is not necessary.

L40 in RFC text.

+  pub async fn deleter_with(&self) -> FutureDeleter;

same as above.

L99 in RFC text.

let deleter = op.deleter()
  // Allow up to 8 concurrent delete tasks, default to 1.
  .concurrent(8)
  // Configure the buffer size to 1000, default value provided by services.
  .buffer(1000)
  .await?;

// Add a single file to the deleter.
deleter.delete(path).await?;

// Add a stream of files to the deleter.
deleter.delete_all(&mut lister).await?;

// Close deleter, make sure all input files are deleted.
deleter.close().await?;

op.deleter() should be op.deleter_with()

[Xuanwo]

Thanks a lot! Would you like to submit a PR to fix them all?

[meteorgan]

Hi, @Xuanwo Have you started working on this issue ? I'm interested in it.

[Xuanwo]

Hi, @Xuanwo Have you started working on this issue ? I'm interested in it.

I'm currently working on this and will create separate tasks based on my progress.

[rich7420]

Hello , could I try this issue ?
It seems that there still have some files in core and bindings needs to do.
cc. @Xuanwo , @tisonkun

[tisonkun]

@rich7420 Sure. Go ahead and feel free to ping me as a reviewer for your PR.