Apart from the medications (dmard) for ra you require
1. Good pain
relief a) in the form of medications used judiciously without causing much liver or kidney side effects
b) in the form. Of physical modalities 2 you also need physiotherapy
to prevent joint contractures and muscle wasting and deformities
3 appropriate use of splints will prevent contractures and deformities and subluxation.
The main idea is to prevent any permanent damage to the joints during the time of relapse. Please consult a physical medicine and rehabilitation specialist near your area for advice.