There was an Episcopal manor in Karja in the Middle Ages; afterwards, it belonged to the von Derfeldens, von Samsonite's and von Sengbusches. The single-storey wooden central part of the main building dates from the 18th century, while the two-storey sections date from the 19th and 20th centuries. At present, the building houses the Karja information room.

By the historical distribution the manor was in Karja Parish in Saaremaa County. By the present administrative distribution it belongs to the Leisi Municipality in Saaremaa County.