What is the difference between ‘substitute’ and ‘replace with’?

Can we use ‘substitute’ and ‘replace with’ interchangeably? How are these two different?