Commit Graph

2 Commits

Author SHA1 Message Date
Arun
6ec8560436 Update hieradet.py
Not used  
head_dim = dim_out // num_heads
self.scale = head_dim**-0.5

F.scaled_dot_product_attention takes care of this automatically.
2024-08-07 11:35:46 +05:30
Haitham Khedr
0c5f8c5432 Initial commit 2024-07-29 21:54:20 +00:00