attribute.c: Clear attribute bits already at remove time.

attribute.c: Clear attribute bits already at remove time.

If an attribute gets removed, the old code deferred clearing the
corresponding attribute bit in the afsi of all audio files until
that bit got reclaimed by add_att.  This is problematic because of
the new no_attribute_set mood method.

So clear the bit already in the rmatt callback.