We are all impressed by / with your knowledge of the subject.

这里是否也是 by 和 with 都可以呢?

可以,但本句中by比with更多见。