I don't know if it's any quicker (and the underlaying process of new FileWriter probably does it anyway)
( new File( filename ) ).delete( ) ;
That should rid the file without creating a new stream to as does
new FileWriter( filename ) ;
If you don't need a new OutputStream, I'd
test this way for performance.