Add Features through Feature Suggestion to Fix Conflicts¶
As you are updating the models by editing the schema or adding labels, conflicts between the label and the system’s prediction will arise. You can view an instructional video about resolving conflicts through features here.
The system will suggest features to remedy these conflicts. To resolve specific system conflicts in a label, click on the conflict count to the right.
Feature suggestions are shown inline in the document that has the conflict to show the suggested feature in context (if they are not, you can click "Show Features" in the upper right of the document widget). Suggested features are also shown at the bottom right of the page. The feature suggestion pane is closed when there are no suggestions. Feature suggestions are associated with specific categories. Duet suggests the features to help the system discriminate between categories and resolve the conflicts but it needs help from the user to review the suggestion. Hovering over a suggested feature will show the category for which it is suggested. You need to review the content of the feature before adding it.
Some suggestions will contain a yellow Duet logo. These features are manually curated features for the model's domain. The other non-curated features are formed automatically from the user data. Curated features designate high-quality for the domain. In the feature suggestion pane at the bottom right corner of the page, you can filter the suggested features by category. Filtering can allow you to review features in more detail.
Clicking a suggestion will open a popup where you can add it as a new feature or add the suggested phrases to an existing feature. If you'd like to prevent this feature from being suggested in the future, press "Block this feature".
If you'd like to access the block list to review the features that you've blocked, click the menu option found at the top right of the navbar.
This will open a pop-up where you can remove blocked features. Once removed, they will reappear in the suggested features widget at the bottom right of the screen.
Pay attention to fixing conflicts before pursuing labeling. As you label, keep your eye on the quality metric of all categories after adding each label to monitor progress. Resolve conflicts as they arise and review suggested features. The teaching loop is fully interactive where the model gets updated with every schema edit, labeling a new document, or adding a new feature.
Features that you've already added to your model are shown in the Model Features widget at the bottom of the screen. Curated features are shown with the Duet logo.
A good way to test whether features are positively or negatively contributing to your quality metric is by making features inactive. Making an active feature inactive disables it during model training but doesn't delete the feature from the model entirely. It is only made ineffective during training. With a simple click, a deactivated feature can be reactivated without having to recreate the feature from scratch. You can activate a feature by clicking the feature in the Model Features widget, and then deactivating and pressing "Update" in the pop-up.