remove more cugraph stuff from build_python.sh #33

Job	Run time
checks / other-checks	34s
changed-files / Check changed files	6s
checks / check-style	1m 4s
pr-builder / run	1s
	1m 45s

Provide feedback