Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Zoho Cliq support #69

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 29 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ This code has only been tested with Python >= 3.6.

The library is designed to be used in a seamless way, with minimal code modification: you only need to add a decorator on top your main function call. The return value (if there is one) is also reported in the notification.

There are currently *twelve* ways to setup notifications:
There are currently *thirteen* ways to setup notifications:

| Platform | External Contributors |
| :-----------------------------------: | :---------------------------------------------------------------------------------------: |
Expand All @@ -36,6 +36,7 @@ There are currently *twelve* ways to setup notifications:
| [DingTalk](#dingtalk) | [@wuutiing](https://github.com/wuutiing) |
| [RocketChat](#rocketchat) | [@radao](https://github.com/radao) |
| [WeChat Work](#wechat-work) | [@jcyk](https://github.com/jcyk) |
| [Zoho Cliq](#zoho-cliq) | [@raghul-selvaraj-sj](https://github.com/raghul-selvaraj-sj) |


### Email
Expand Down Expand Up @@ -398,6 +399,33 @@ knockknock wechat \
You can also specify an optional argument to tag specific people: `user-mentions=["<list_of_userids_you_want_to_tag>"]` and/or `user-mentions-mobile=["<list_of_phonenumbers_you_want_to_tag>"]`.


### Zoho Cliq

Thanks to [@raghul-selvaraj-sj](https://github.com/raghul-selvaraj-sj), you can also use Zoho Cliq to get notifications. You'll have to get your Cliq Channel/Bot [webhook URL](https://www.zoho.com/cliq/help/platform/webhook-tokens.html).

#### Python

```python
from knockknock import cliq_sender

@cliq_sender(webhook_url="<webhook_url_to_your_cliq_channel>")
def train_your_nicest_model(your_nicest_parameters):
import time
time.sleep(10)
return {'loss': 0.9} # Optional return value
```

#### Command-line

```bash
knockknock cliq \
--webhook-url <webhook_url_to_your_cliq_channel> \
sleep 10
```

You can also specify an optional argument to tag specific people: `user_mentions=[<your_zoho_user_id>, <your_teammate_zoho_user_id>]`.


## Note on distributed training

When using distributed training, a GPU is bound to its process using the local rank variable. Since knockknock works at the process level, if you are using 8 GPUs, you would get 8 notifications at the beginning and 8 notifications at the end... To circumvent that, except for errors, only the master process is allowed to send notifications so that you receive only one notification at the beginning and one notification at the end.
Expand Down
1 change: 1 addition & 0 deletions knockknock/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,4 @@
from knockknock.dingtalk_sender import dingtalk_sender
from knockknock.wechat_sender import wechat_sender
from knockknock.rocketchat_sender import rocketchat_sender
from knockknock.cliq_sender import cliq_sender
15 changes: 14 additions & 1 deletion knockknock/__main__.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,8 @@
sms_sender,
teams_sender,
telegram_sender,
wechat_sender,)
wechat_sender,
cliq_sender, )

def main():
parser = argparse.ArgumentParser(
Expand All @@ -33,6 +34,18 @@ def main():
help="Optional user alias or full email address to notify, as comma separated list.")
chime_parser.set_defaults(sender_func=chime_sender)

# Zoho Cliq
cliq_parser = subparsers.add_parser(
name="cliq", description="Send a Cliq message before and after function " +
"execution, with start and end status (successfully or crashed).")
cliq_parser.add_argument(
"--webhook-url", type=str, required=True,
help="The webhook URL to access your Cliq channel/bot.")
cliq_parser.add_argument(
"--user-mentions", type=lambda s: s.split(","), required=False, default=[],
help="Optional user ids to notify, as comma seperated list.")
cliq_parser.set_defaults(sender_func=cliq_sender)

# Desktop
desktop_parser = subparsers.add_parser(
name="desktop", description="Send a desktop notification before and after function " +
Expand Down
109 changes: 109 additions & 0 deletions knockknock/cliq_sender.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,109 @@
import datetime
import functools
import json
import os
import socket
import traceback
from typing import List

import requests

DATE_FORMAT = "%Y-%m-%d %H:%M:%S"


def cliq_sender(webhook_url: str, user_mentions: List[str] = []):
"""
cliq sender wrapper: execute func, send a Cliq message with the end status
(successfully finished or crashed) at the end. Also send a Cliq message before
executing func.

`webhook_url`: str
The webhook URL to access your channel/bot.
Visit https://www.zoho.com/cliq/help/platform/webhook-tokens.html for more details.
`user_mentions`: List[str] (default=[])
Optional users ids to notify.
"""

# Visit https://www.zoho.com/cliq/help/restapi/v2/#cliq_rest_api for more api related details
user_mentions = ['{@' + str(user_mention) + '}' for user_mention in user_mentions]

dump = {
"bot": {
"name": "Knock Knock",
"image": "https://huggingface.co/front/assets/huggingface_logo.svg",
}
}

def decorator_sender(func):
@functools.wraps(func)
def wrapper_sender(*args, **kwargs):
start_time = datetime.datetime.now()
host_name = socket.gethostname()
func_name = func.__name__

# Handling distributed training edge case.
# In PyTorch, the launch of `torch.distributed.launch` sets up a RANK environment variable for each process.
# This can be used to detect the master process.
# See https://github.com/pytorch/pytorch/blob/master/torch/distributed/launch.py#L211
# Except for errors, only the master process will send notifications.
if 'RANK' in os.environ:
master_process = (int(os.environ['RANK']) == 0)
host_name += ' - RANK: %s' % os.environ['RANK']
else:
master_process = True

if master_process:
contents = ['Your training has started 🎬',
'Machine name: %s' % host_name,
'Main call: %s' % func_name,
'Starting date: %s' % start_time.strftime(DATE_FORMAT)]
contents.append(' '.join(user_mentions))
dump['text'] = '\n'.join(contents)
requests.post(webhook_url, json.dumps(dump))

try:
value = func(*args, **kwargs)

if master_process:
end_time = datetime.datetime.now()
elapsed_time = end_time - start_time
contents = ["Your training is complete 🎉",
'Machine name: %s' % host_name,
'Main call: %s' % func_name,
'Starting date: %s' % start_time.strftime(DATE_FORMAT),
'End date: %s' % end_time.strftime(DATE_FORMAT),
'Training duration: %s' % str(elapsed_time)]

try:
str_value = str(value)
contents.append('Main call returned value: %s' % str_value)
except:
contents.append('Main call returned value: %s' % "ERROR - Couldn't str the returned value.")

contents.append(' '.join(user_mentions))
dump['text'] = '\n'.join(contents)
requests.post(webhook_url, json.dumps(dump))

return value

except Exception as ex:
end_time = datetime.datetime.now()
elapsed_time = end_time - start_time
contents = ["Your training has crashed ☠️",
'Machine name: %s' % host_name,
'Main call: %s' % func_name,
'Starting date: %s' % start_time.strftime(DATE_FORMAT),
'Crash date: %s' % end_time.strftime(DATE_FORMAT),
'Crashed training duration: %s\n\n' % str(elapsed_time),
"Here's the error:",
'%s\n\n' % ex,
"Traceback:",
'%s' % traceback.format_exc()]
contents.append(' '.join(user_mentions))
dump['text'] = '\n'.join(contents)
requests.post(webhook_url, json.dumps(dump))
raise ex

return wrapper_sender

return decorator_sender