Unfortunately you can’t.
The only way to delete a directory from a Android device connected with adb is to execute:
adb shell rm -r /path/to/dir
and only if you have permissions, ie you have a rooted device or you are working with Android’s emulator.