Commit Graph
2 Commits
Author SHA1 Message Date
Arun 086daf0641 Merge branch 'main' into patch-1 2024-08-07 21:50:26 +05:30
Arun 6ec8560436 Update hieradet.py
Not used  
head_dim = dim_out // num_heads
self.scale = head_dim**-0.5

F.scaled_dot_product_attention takes care of this automatically.
2024-08-07 11:35:46 +05:30