Find and delete files from unix directory of multiple patterns

I need to delete files from a unix directory having patterns like ‘bkp’, ‘backup’, ‘bak’.
Basically I want to delete all the backup files.

Files in the directory:

A001.txt_bkp
A001.txt
A002.csv_backup
A002.csv
A003.csv
A003_bak.csv

I want to keep below files

A001.txt
A002.csv
A003.csv