Yes, PS center link and idler arm are different than MS parts. MS centerlink also has the stud to connect the pitman arm to and do not have threads on DS end to connect the control valve.
If you are purchasing the PS to manual adapter, you can use PS center link and idler. Remove the ram and discard it, remove the control valve and install the adapter in place of it.
If you have some fab skills, you can install a Prius EPAS for about $100 instead of Borgeson box. You will still need the PS to manual adapter but can use your current steering box if it is in good condition. You get 3.5-4 turn from lock to lock steering with PS box and get rid of pump, hoses etc.