Prevent unnecessary conversions between ByteBuf and PublicHeader, PrivateHeader, etc.

Was introduces in !343 (merged)

Example:

• IntermediateEnvelope.of(PublicHeader,PrivateHeader,T).getPublicHeader()
• IntermediateEnvelope.of(PublicHeader,bytes).getPublicHeader()