Why aren't Irish jokes considered "racist"?

Because Irish people are still white people, the difference is mostly cultural. Also, there isn't really much of any hate against Irish people so a joke isn't likely to be construed as being hateful. Same reasons it's not all that politically incorrect to make jokes about Polish people.