Distributed Computing describes a computer architecture that uses multiple computers connected via a network to provide one or more services.  By using multiple computers, the service can be made highly reliable (the service continues even if one or more computers fail) and the service can support a large number of users (and can often support more users by adding more computers to the network).  Many of the services offered on the internet today use this architecture.
For more information: 

• Introduction by IBM