Research shows that persona prompting "reliably" damages accuracy for some types of tasks but works well in other categories.
Large language models appear aligned, yet harmful pretraining knowledge persists as latent patterns. Here, the authors prove current alignment creates only local safety regions, leaving global ...