Pilot implementations of new technology in organizations have been proposed as a promising approach to uncover emergent knowledge and learning of the specific work practices in which they are implemented. In this research proposal I will discuss how a participatory approach to evaluating CSCW applications may support mutual learning.