add nsys profiling to ESM-2 benchmarking and apply rope

[sichu2023]

No description provided.

[github-actions]

beep boop 🤖: 🚨 The following files must be fixed before merge!

---

Your code was analyzed with PyLint. The following annotations have been identified:

************* Module nemo.collections.llm.bert.model.esm
nemo/collections/llm/bert/model/esm.py:7:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/bert/model/esm.py:16:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/bert/model/esm.py:25:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/bert/model/esm.py:3:0: W0611: Unused HuggingFaceBertModel imported from nemo.collections.llm.bert.model.bert (unused-import)
************* Module nemo2_esm2_tp
nemo2_esm2_tp.py:52:0: C0301: Line too long (153/119) (line-too-long)
nemo2_esm2_tp.py:53:0: C0301: Line too long (179/119) (line-too-long)
nemo2_esm2_tp.py:28:0: C0116: Missing function or method docstring (missing-function-docstring)
nemo2_esm2_tp.py:22:0: W0611: Unused AutoTokenizer imported from nemo.collections.common.tokenizers (unused-import)

-----------------------------------
Your code has been rated at 9.04/10

---

Mitigation guide:

• Add sensible and useful docstrings to functions and methods
• For trivial methods like getter/setters, consider adding # pylint: disable=C0116 inside the function itself
• To disable multiple functions/methods at once, put a # pylint: disable=C0116 before the first and a # pylint: enable=C0116 after the last.

By applying these rules, we reduce the occurance of this message in future.

Thank you for improving NeMo's documentation!