Support for Comet Logger

🚀 Feature Request

I would like to add support for a Comet ML Logger to Catalyst

Motivation

Comet provides a suite of logging and visualization options that makes it easy for practitioners to analyze, visualize and share the results of their model development process. I think it would work very well with Catalyst’s focus on reproducibility, rapid experimentation, and codebase reuse.

Proposal

The integration would follow a similar pattern to previous ones such as MLFlow, Neptune, and WandB. The workflow would look something like

import comet_ml
import torch
from torch.utils.data import DataLoader, TensorDataset
from catalyst import dl
from catalyst.loggers.comet import CometLogger

# data
num_samples, num_features = int(1e4), int(1e1)
X, y = torch.rand(num_samples, num_features), torch.rand(num_samples)
dataset = TensorDataset(X, y)
loader = DataLoader(dataset, batch_size=32, num_workers=1)
loaders = {"train": loader, "valid": loader}

# model, criterion, optimizer, scheduler
model = torch.nn.Linear(num_features, 1)
criterion = torch.nn.MSELoss()
optimizer = torch.optim.Adam(model.parameters())
scheduler = torch.optim.lr_scheduler.MultiStepLR(optimizer, [3, 6])
logger = CometLogger()

# model training
runner = dl.SupervisedRunner()
runner.train(
    model=model,
    criterion=criterion,
    optimizer=optimizer,
    scheduler=scheduler,
    loaders=loaders,
    logdir="./logdir",
    valid_loader="valid",
    valid_metric="loss",
    minimize_valid_metric=True,
    num_epochs=8,
    verbose=True,
    loggers={"comet": logger},
)

Alternatives

Did not consider alternatives for this specific proposal, as this enhancement is to help Comet users log data from Catalyst.

Additional context

Checklist

• feature proposal description
• motivation
• extra proposal context / proposal alternatives review

FAQ

Please review the FAQ before submitting an issue:

• I have read the documentation and FAQ
• I have reviewed the minimal examples section
• I have checked the changelog for main framework updates
• I have read the contribution guide
• I have joined Catalyst slack (#__questions channel) for issue discussion

[DN6]

Hi, @Scitator, one of our engineers has something in the works. We’re just testing and running through the Catalyst checklist for creating a PR to make sure we don’t miss anything. We can open a PR within the next couple of days if that’s okay?

[Scitator]

Yup, that would be okay, thanks!