Skip to content

lightning-liquidity: Refactor LSPS1 service-side#4282

Open
tnull wants to merge 36 commits intolightningdevkit:mainfrom
tnull:2025-11-lsps1-refactor
Open

lightning-liquidity: Refactor LSPS1 service-side#4282
tnull wants to merge 36 commits intolightningdevkit:mainfrom
tnull:2025-11-lsps1-refactor

Conversation

@tnull
Copy link
Contributor

@tnull tnull commented Dec 12, 2025

Closes #3480.

We 'refactor' (rewrite) the LSPS1ServiceHandler, move state handling to a dedicated PeerState, add an STM pattern, add persistence for the service state, add some more critical API paths, add test coverage, and finally remove the cfg(lsps1_service) flag.

@ldk-reviews-bot
Copy link

ldk-reviews-bot commented Dec 12, 2025

👋 I see @TheBlueMatt was un-assigned.
If you'd like another reviewer assignment, please click here.

@tnull tnull marked this pull request as draft December 12, 2025 15:28
@tnull tnull force-pushed the 2025-11-lsps1-refactor branch 4 times, most recently from 773316a to fb519ab Compare December 12, 2025 16:08
@codecov
Copy link

codecov bot commented Dec 12, 2025

Codecov Report

❌ Patch coverage is 71.76113% with 279 lines in your changes missing coverage. Please review.
✅ Project coverage is 86.11%. Comparing base (14e522f) to head (ac4c5f4).
⚠️ Report is 10 commits behind head on main.

Files with missing lines Patch % Lines
lightning-liquidity/src/lsps1/service.rs 59.73% 168 Missing and 16 partials ⚠️
lightning-liquidity/src/lsps1/peer_state.rs 84.92% 31 Missing and 32 partials ⚠️
lightning/src/util/ser.rs 38.09% 10 Missing and 3 partials ⚠️
lightning-liquidity/src/persist.rs 65.51% 6 Missing and 4 partials ⚠️
lightning-liquidity/src/manager.rs 80.95% 2 Missing and 6 partials ⚠️
lightning-liquidity/src/lsps1/msgs.rs 90.90% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4282      +/-   ##
==========================================
+ Coverage   85.94%   86.11%   +0.17%     
==========================================
  Files         159      161       +2     
  Lines      104644   105717    +1073     
  Branches   104644   105717    +1073     
==========================================
+ Hits        89934    91043    +1109     
+ Misses      12204    12091     -113     
- Partials     2506     2583      +77     
Flag Coverage Δ
tests 86.11% <71.76%> (+0.17%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@tnull tnull force-pushed the 2025-11-lsps1-refactor branch 2 times, most recently from b96685b to c6eb6b3 Compare December 15, 2025 12:27
@tnull tnull self-assigned this Dec 18, 2025
@tnull tnull moved this to Goal: Merge in Weekly Goals Dec 18, 2025
@tnull tnull added this to the 0.3 milestone Jan 29, 2026
@tnull tnull force-pushed the 2025-11-lsps1-refactor branch from c6eb6b3 to a2aa7c3 Compare February 4, 2026 14:53
@tnull
Copy link
Contributor Author

tnull commented Feb 4, 2026

Rebased to resolve conflicts.

@tnull tnull marked this pull request as ready for review February 5, 2026 12:58
@tnull tnull requested a review from TheBlueMatt February 5, 2026 12:58
@tnull
Copy link
Contributor Author

tnull commented Feb 5, 2026

Should be good for review.

@ldk-reviews-bot
Copy link

🔔 1st Reminder

Hey @TheBlueMatt! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

@ldk-reviews-bot
Copy link

🔔 2nd Reminder

Hey @TheBlueMatt! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

&& payment_details.onchain.is_some()
{
// bLIP-51: 'LSP MUST disable on-chain payments if the client omits this field.'
let err = "Onchain payments must be disabled if no refund_onchain_address is set.".to_string();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This requirement doesn't appear to be documented in LSPS1ServiceEvent::RequestForPaymentDetails or LSPS1PaymentInfo, but I'm not sure we should bother erroring here vs just removing the unsupported option before sending the order to the peer?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, good point. Turns out we didn't expose refund_onchain_address anywhere. I now added a fixup documenting the requirement on both the method and the event, added a refund_onchain_address field to the event and a onchain_payment_required method allowing the LSP to reject a request for this reason.

I think auto-stripping the onchain payment variant isn't great as we might end up without any payment variant, and would need to auto-reject the request then. Might be preferable to leave that up to the LSP in general?

) -> ChannelOrder {
let state = ChannelOrderState::new(payment_details);
let channel_order = ChannelOrder { order_params, state, created_at };
self.outbound_channels_by_order_id.insert(order_id, channel_order.clone());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

might want some kind of size limit here to limit dos, tho we could also just do it at the start of the flow.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I now added a commit following the approach we took for LSPS2, i.e., adding MAX_TOTAL_PEERS, MAX_REQUESTS_PER_PEER and MAX_TOTAL_PENDING_REQUESTS limits.

let msg = LSPS1Message::Response(request_id.clone(), response).into();
message_queue_notifier.enqueue(counterparty_node_id, msg);
let err = format!("Failed to handle request due to: {}", e);
let action = ErrorAction::IgnoreAndLog(Level::Error);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here and likely elsewhere, we really can't log at Error just because someone sends us a bogus message.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, note that we already silently fail if we can't parse the message at all. This basically follows what we do elsewhere in the codebase. I think we should do #3492 as a follow-up to make sure we follow the same approach everywhere. I'll tag that 0.3

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, okay. I'm not a fan of making things worse than it is only to fix it later, but...

#[cfg(not(feature = "time"))]
{
// TODO: We need to find a way to check expiry times in no-std builds.
all_payment_details_expired = false;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably can just insta-remove things that are failed, at least.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think so, as we still want to show the Failed state back to the user querying their order status.

self.state,
ChannelOrderState::ExpectingPayment { .. }
| ChannelOrderState::FailedAndRefunded { .. }
);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we ever want to prune things that were completed? A two year old channel lease that expired 18 months ago probably isn't interesting?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, probably, and we have the same issue with LSPS2. I think it would be good to add a consistent API that works for both in a follow up. Could be to leave it to the user to manually call a prune method, or possibly set an auto-prune config flag in the respective service configs? Anyway, I'd prefer to leave that as a follow-up.

@ldk-reviews-bot
Copy link

👋 The first review has been submitted!

Do you think this PR is ready for a second reviewer? If so, click here to assign a second reviewer.

@tnull tnull force-pushed the 2025-11-lsps1-refactor branch 4 times, most recently from 3ae7578 to 4489325 Compare February 11, 2026 12:27
@tnull tnull requested a review from TheBlueMatt February 11, 2026 12:50
@ldk-reviews-bot
Copy link

🔔 1st Reminder

Hey @TheBlueMatt! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

@ldk-reviews-bot
Copy link

🔔 2nd Reminder

Hey @TheBlueMatt! This PR has been waiting for your review.
Please take a look when you have a chance. If you're unable to review, please let us know so we can find another reviewer.

tnull added 19 commits March 2, 2026 13:01
Previously, we'd use an event to have the user check the order status
and then call back in. As we already track the order status, we here
change that to a model where we respond immediately based on our state
and have the user/LSP update that state whenever it detects a change
(e.g., a received payment, reorg, etc.). In the next commmit we will
add/modify the corresponding API methods to do so.
We add the serializations for all types that will be persisted as part
of the `PeerState`.
We follow the model already employed in LSPS2/LSPS5 and implement
state pruning and persistence for `LSPS1ServiceHandler` state.

Signed-off-by: Elias Rohrer <dev@tnull.de>
.. we read the persisted state in `LiquidityManager::new`

Signed-off-by: Elias Rohrer <dev@tnull.de>
As per spec, we check that the user provides at least one payment detail
*and* that they don't provide onchain payment details if
`refund_onchain_address` is unset.
We add a method that allows the LSP to signal to the client the token
they used was invalid.

We use the `102` error code as proposed in
lightning/blips#68.
We test the just-added API.

Co-authored by Claude AI
This refactors `ChannelOrder` to use an internal state machine enum
`ChannelOrderState` that:
- Encapsulates state-specific data in variants (e.g., `channel_info`
  only available in `CompletedAndChannelOpened`)
- Provides type-safe state transitions
- Replaces the generic `update_order_status` API with specific
  transition methods: `order_payment_received`, `order_channel_opened`,
  and `order_failed_and_refunded`

The state machine has four states:
- `ExpectingPayment`: Initial state, awaiting payment
- `OrderPaid`: Payment received, awaiting channel open
- `CompletedAndChannelOpened`: Terminal state with channel info
- `FailedAndRefunded`: Terminal state for failed/refunded orders

Co-Authored-By: HAL 9000
Signed-off-by: Elias Rohrer <dev@tnull.de>
Add two new integration tests to cover the new public API methods:

- `lsps1_order_state_transitions`: Tests the full flow of
  `order_payment_received` followed by `order_channel_opened`,
  verifying that payment states are updated correctly and channel
  info is returned after the channel is opened.

- `lsps1_order_failed_and_refunded`: Tests the `order_failed_and_refunded`
  method, verifying that payment states are set to Refunded.

Co-Authored-By: HAL 9000
Add `lsps1_expired_orders_are_pruned_and_not_persisted` test that verifies:

- Orders with expired payment details (expires_at in the past) are
  accessible before persist() is called
- After persist() is called, expired orders in ExpectingPayment state
  are pruned and no longer accessible
- Pruned orders are not recovered after restart, confirming that
  the pruning also removes the persisted state

Co-Authored-By: HAL 9000
The bLIP-51 specification defines a `HOLD` intermediate payment state:
- `EXPECT_PAYMENT` -> `HOLD` -> `PAID` (success path)
- `EXPECT_PAYMENT` -> `REFUNDED` (failure before payment)
- `HOLD` -> `REFUNDED` (failure after payment received)

This commit adds the `Hold` variant to `LSPS1PaymentState` and updates
the state machine transitions:

- `payment_received()` now sets payment state to `Hold` (not `Paid`)
- `channel_opened()` transitions payment state from `Hold` to `Paid`
- Tests updated to verify the correct state at each transition

This allows LSPs to properly communicate when a payment has been
received but the channel has not yet been opened (e.g., Lightning
HTLC held, or on-chain tx detected but channel funding not published).

Co-Authored-By: HAL 9000
Turns out this was another variant we didn't actually use anywhere. So
we're dropping it.
We previously had no way to reject requests in case the LSP requires
onchain payment while the client not providing
`refund_onchain_address`. Here we add a method allowing to do so.
Add per-peer and global rate limiting to `LSPS1ServiceHandler` to
prevent resource exhaustion, mirroring the existing LSPS2 pattern.

Introduce `MAX_PENDING_REQUESTS_PER_PEER` (10),
`MAX_TOTAL_PENDING_REQUESTS` (1000), and `MAX_TOTAL_PEERS` (100000)
constants and enforce them in `handle_create_order_request`. Rejected
requests receive a `CreateOrderError` with
`LSPS0_CLIENT_REJECTED_ERROR_CODE`. A `total_pending_requests` atomic
counter tracks the global count, and a `verify_pending_request_counter`
debug assertion ensures it stays in sync.

Co-Authored-By: HAL 9000
@tnull tnull force-pushed the 2025-11-lsps1-refactor branch from e31b5c8 to ac4c5f4 Compare March 2, 2026 12:21
@tnull
Copy link
Contributor Author

tnull commented Mar 2, 2026

Addressed/responded to pending comments.

@tnull tnull requested a review from TheBlueMatt March 2, 2026 12:23
@TheBlueMatt TheBlueMatt removed their request for review March 3, 2026 15:52
@tnull tnull requested a review from TheBlueMatt March 4, 2026 14:01
@TheBlueMatt
Copy link
Collaborator

I believe I responded to the two open threads, so just waiting on a response there and then we can move forward.

@TheBlueMatt TheBlueMatt removed their request for review March 6, 2026 22:01
@tnull tnull force-pushed the 2025-11-lsps1-refactor branch from ac4c5f4 to ec49c6c Compare March 12, 2026 22:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Goal: Merge

Development

Successfully merging this pull request may close these issues.

LSPS1 integration tracking issue

4 participants