Is a partial release of the deposit possible?

No, partial release is neither possible nor necessary. Since the tenant does not wait for a refund and pays only the fee during the term.