#Maintenance Override
There must be some way to get into the system, install a new version of the firmware (now with 20% fewer bugs!!!), reboot it after a crash, etc.
After the first cases have wormed their way through a series of administrative orders, court injunctions, decisions, and appeals, there will be rules that inmates must surrender the access codes to their systems. What can or cannot be done depends on the political climate at the time, perhaps data cannot be used but the system can be shut down, perhaps there will be a full download for analysis by police AIs, perhaps the system will go into some sort of "airplane mode" with stand-alone use only.
#Remember Medical Implants
It is quite possible that implants for medical purposes will be common before "elective" implants reach the market. Pacemakers. Hearing aids. Artificial eyes. Prostetic limbs. Taking that away from an inmate, especially one who is awaiting trial and not yet found guilty, might be a civil (or human) rights violation.
Note that in some places in the world, inmates have a right to free and adequate medical care. That might even include new implants if the old ones wear out.
If the legal precedents are set with medical implants in mind, your story could get interesting ...