[HOLD for payment 2023-10-16] [$500] Chat - App removes space from start for text below header text

[kbecciv]

If you haven’t already, check out our contributing guidelines for onboarding and email contributors@expensify.com to request to join our Slack channel!

---

Action Performed:

1. Open the app
2. Open any report
3. Send message with normal text in first line and some space before text in next line
4. Copy that text or edit and observe that space is preserved in second line which is correct
5. Now send message with header text (# in front) in first line and some space before text in next line
6. Copy that text or edit and observe that it removes the space before second line text

Expected Result:

App should preserve space added before text in second or any other line except first line

Actual Result:

App does not preserve space added before text in second or any other line if first line has header text (text with # in beginning)

Workaround:

Unknown

Platforms:

Which of our officially supported platforms is this issue occurring on?

• Android / native
• Android / Chrome
• iOS / native
• iOS / Safari
• MacOS / Chrome / Safari
• MacOS / Desktop

Version Number: 1.3.70.2
Reproducible in staging?: y
Reproducible in production?: y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation

space.before.text.not.preserved.below.header.text.mp4

Recording.4465.mp4

Expensify/Expensify Issue URL:
Issue reported by: @dhanashree-sawant
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1694453805196449

View all open jobs on GitHub

Upwork Automation - Do Not Edit

• Upwork Job URL: https://www.upwork.com/jobs/~01a29ca52e1304c30b
• Upwork Job ID: 1702326265887232000
• Last Price Increase: 2023-09-14
• Automatic offers:
• s-alves10 | Contributor | 26744986
• dhanashree-sawant | Reporter | 26744992

Issue Owner

Current Issue Owner: @anmurali

[melvin-bot]

Job added to Upwork: https://www.upwork.com/jobs/~01a29ca52e1304c30b

[melvin-bot]

Triggered auto assignment to @anmurali (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

[melvin-bot]

Bug0 Triage Checklist (Main S/O)

• This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
• This bug is not a duplicate report (check E/App issues and #expensify-bugs)
  • If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead
• This bug is reproducible using the reproduction steps in the OP. S/O
  • If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
  • If the reproduction steps aren't clear and you determine the correct steps, please update the OP.
• This issue is filled out as thoroughly and clearly as possible
  • Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.
• I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

[melvin-bot]

Triggered auto assignment to @peterdbarkerUK (External), see https://stackoverflow.com/c/expensify/questions/8582 for more details.

[melvin-bot]

Triggered auto assignment to Contributor-plus team member for initial proposal review - @parasharrajat (External)

[dummy-1111]

Proposal

Please re-state the problem that we are trying to solve in this issue.

Copying or editing the message removes spaces at the beginning of the line if the previous line is a header text. If the next line is a header text, copying or editing removes trailing spaces

What is the root cause of that problem?

We have html-to-markdown rule regarding heading here

        regex: /[^\S\r\n]*<(h1)(?:"[^"]*"|'[^']*'|[^'">])*>(.*?)<\/\1>(?![^<]*(<\/pre>|<\/code>))[^\S\r\n]*/gi,

As you can see, we match space characters(and \r\n) before and after the heading tag. The result is shown below

This is the root cause

What changes do you think we should make in order to solve the problem?

We need to match only the <h1>xxx</h1> part of the string
Removing [^\S\r\n]* from the start and end will preserve all space characters and newline characters before and after the heading string. So the new regex would be

        regex: /<(h1)(?:"[^"]*"|'[^']*'|[^'">])*>(.*?)<\/\1>(?![^<]*(<\/pre>|<\/code>))/gi,

There are two test errors by this change

test('Test html to heading1 markdown when h1 tag is in the beginning of the line', () => {
    const testString = '<h1>heading1</h1> in the beginning of the line';
    const resultString = '# heading1\n'
    + 'in the beginning of the line';
    expect(parser.htmlToMarkdown(testString)).toBe(resultString);
});

    - in the beginning of the line
    +  in the beginning of the line

test('Test html to heading1 markdown when h1 tags are in the middle of the line', () => {
    const testString = 'this line has a <h1>heading1</h1> in the middle of the line';
    const resultString = 'this line has a\n'
    + '# heading1\n'
    + 'in the middle of the line';
    expect(parser.htmlToMarkdown(testString)).toBe(resultString);
});

    - this line has a
    + this line has a 
      # heading1
    - in the middle of the line
    +  in the middle of the line

This is something expected in this issue.

Note: In case we don't want to preserve before the heading, we should keep [^\S\r\n]* at the beginning, but I don't think we need to discard them.

Result

27445.mp4

What alternative solutions did you explore? (Optional)

[jaylalakiya]

Proposal

Please re-state the problem that we are trying to solve in this issue.

App removes spaces before line where previous line is header text when pasting the copied text in chat. This problem is not only with selected platforms in issue description, but instead it persists on all the platforms.

What is the root cause of that problem?

When the html is converted to markdown it removes trailing spaces after heading tag even if there is text after trailing spaces which causes this behaviour of removing leading spaces from next line

What changes do you think we should make in order to solve the problem?

We should modify regex to not remove trailing spaces because trailing spaces are trimmed somewhere else.
Current regex: /[^\S\r\n]*<(h1)(?:"[^"]*"|'[^']*'|[^'">])*>(.*?)<\/\1>(?![^<]*(<\/pre>|<\/code>))[^\S\r\n]*/gi
We should remove trailing spaces regex [^\S\r\n]*

This is not a breaking change as it only removes trailing spaces and not leading spaces (see video attached below). Trailing spaces are trimmed here in case there is no text after spaces.

Result:
https://github.com/Expensify/App/assets/63226109/0982d02f-58f3-4213-a5ba-7b08393d1891

What alternative solutions did you explore? (Optional)