Confirmed from our engineers that we use Hive meta storage not AWS Glue.
Ok cool, it looks like you can't run ALTER TABLE from AWS Athena. Which calls AWS Glue to run batch_create_partition. You might want to ask why that is and what they recommend to update table ddl's with new partitions if ALTER TABLE is blocked.
In the mean time i will raise another Pull Request to initial try ALTER TABLE and if permissions fail then fall back to MSCK REPAIR. I will give this some thought as I don't really want to slow down the package.
1 Like
The latest dev version has got a fall back clause. If ALTER TABLE is unable to be performed due to permissions then MSCK REPAIR TABLE will be called instead. I hope this fixes your problem.
Hi @larefly, since our system uses Hive meta store and not AWS Glue for Athena, I don't think it matters either way, but at least now it will not return an error. Thanks!
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.