As has been suggested, the subquery,
SELECT 1 FROM table2 WHERE A.COLUMN <> B.COLUMN
, is probably returning more than 1 row. So, there is more than 1 row where A.COLUMN <> B.COLUMN.
If you want a single value returned, change the subquery.
If possible, try to run the subquery by itself to see what it is returning.